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Slightj in every sense^ assuredly it will be. Probably in the same way it 
will be superficial; but ■W’hen I used the word I was thinking chiefly of its 
most modern connotation. I meant that I was going to try to be intelligible. 
I sympathize with those writers who have been obliged by poverty or the exi- 
gences of military service to dispense with education^ and I q.uite understand 
why they discountenance those whose object it has been to express ideas as 
simply;, clear ly^ and briefly as possible. Such desperate methods would 
reduce the longest books of many of our best prophets to a very few pages; 
for when there is no butter to spread you cannot even spread it thin. In 
such dearth the only th^ng to do is to dig mysteriously into the loaf ^ which 
in literature is called being profound. And though there are readers who^ 
having gone down to the bottom of the pit and there failed to discover the 
smallest speck of margarine ^ will venture to call such profundities empty;, 
in the brisker parts of Europe and America the profound style is generally 
held in honour. In me^ however j the airs of a mole or a miner would be mere 
affectation. Besides^ unlike modern poetry and philosophy and philosophic 
fiction^ an essay of this sort cannot hope to appeal to that great public 
which^ in quest of life^ brushes aside all hair-splitting distinctions 
between sense and nonsense. I dare not be profound. And frankly this essay 
would have been written with all the shallow lucidity of Montesquieu, HTmie 
or Voltaire had the essayest known the secret of their superficiality. 



Clive Bell in "Civilization." 



New York: Harcourt, Brace, 1928. Pp, 20-21. 
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Foreword 

A Change-over experiment is one where several li*eatments are tried in 
succession on a single \init ; there are, of course, a number of such units. 
The unit may vary from being an. animal under several diets in succession, 
a patient under several sedatives successively, to a machine under succes- 
sive methods of handling. It is, indeed, astonishing in what varied fields 
it is convenient, profitable, or even inevitable that one employ Change- 
over. Applications arise in Medicine, product testing. Animal Husbandry, 
Industry, etc. Where may one not find questions best studied by submitting 
a given unit to 2 or more successive treatments? 

The present book embodies many new experimental Designs and looks at 
certain questions in a fresh way. Mainly, however, it is written to set 
forth the good things that are available but not being used. It is hoped 
this endeavor may lead to application and even to progress. The emphasis 
is on the problems encoimtered in running experiments, rather than on the 
elaboration of mathematical models. 

The discussion caxi be followed by anyone with the elements of algebra. 

It will seem the more pointful if the reader has already experienced the 

difficulties of making experiments work. It is, indeed, to people who do 
i 

carpy out e:cperiments , or seriously wish to do so, that this work is 
( 

addressed. When the writer was doing so, the present book was what he 
wanted on his shelf. 
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Change-over comparisons in practice . Very briefly^ before the question 
proper of Change-over is considered let it be understood that we are 
concerned here with experimental Design, which involves the arrangement of 
tests or questions, in space, in time, or on entities, in order to discover 
the effect of experimental Treatments. To most people--to most people even 
in the sciences --the problem seems a trivial one. If one wants to know 
the effect of some Treatment, one simply applies the Treatment and observes 
the effect. In fact, it is not so easy. Inconsistencies in response 
whether by men or machines become confused with true complexities in the 
response. That is why there are statisticians or perhaps with less logic, 
but clt . c..,. connotation, biometricians . There are problems other than the 
aforesaid confusion, but let us not bother with them; rather, let us hurry 
to relief from them. The problems will become apparent in their relief. 

A Change-over experiment is a restricted class of experimental design 
when, for example, each of 2 kinds of sedative are tried in siiccessive 
periods on each of a nuinber of patients. The length of time each patient 
sleeps under each kind of sedative is contrasted. This procedure differs 
from an experiment where kind (l) of sedative is given to some patients 
and kind (2) is given to other patients. Then the time patients sleep under 
(l) is contrasted with the time the other patients sleep under (2). This is 
not a Change-over. The distinction made may be familiar to many readers in 
connection with discussion on paired and unpaired t-tests. In general, when 
possible, the change-over experiment is recoraraended as giving the sharper 
contrast between 2 kinds of sedative, because then only the inconsisten- 
cies, from tirr.e to time, in a man's response embarrass the effect of 
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Treatment. Otherwise^ it suffers the greater embarrassment of the inconsis- 
tency from man to man. 

It is obvious, of course, that in Medicine it has long been the practice 
to try alternative Treatments, such as sedatives, on a given patient. And 
this is a legitimate and valuable experimental technique. The matter under 
discussion in the present .book is the trying of several Treatments, 
successively, on a patient and the policy to be pursued under such condi- 
tions as perhaps there being fewer alternatives possible than there are 
Treatments. Such questions have not, however, to the writer's Imowledge 
been pursued so far in Medicine as in Animal Husbandry. There 
change-over experiments are much used. Thus one may use several diets or 
medications on a given cow because she is more like herself from time to 
time than she is like other cows. The comparisons of the Treatments are 
subject ^nly to the inconsistency or variability within a cow rather than 
from cow to cow. The situation is, of course, complicated by the possibil- 
ity that there may be lingering effects, and it is with this possible 
complication that the present book is largely concerned. 

The considerable experimental advantages of Change-over experiments 
ha-ve been sought after with the most effort in Animal Husbandry, but 
apparently are as real in other fields. Statistics is a curious thing--the 
same problems arise in such various fields. To meet a considerable variety 
of problems both in Agriculture and in Industry the writer has taken 
advantage of Change-over experiments. In industrial experimentation, the 
experimental units, such as a machine to make something, resembles itself 
from time to time much more than it resembles alternate units --as in distant 
Animal Husbandry. In such cases, one is inclined to comparisons of Treatments 
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(or methods or materials) within units. One is inclined to try 2 or more 
Treatments (or methods or materials) on a given Machine in order to compare 
them. Such change-over design is perhaps particularly suitable to machines 
which continue much the same for fairly long periods, in contrast to, say, 
cows, which are subject to lactation cyc3.es and other major trends. If it 
is a matter of a subject to try various Treatments, the argument is the same* 

In this book the author sets forth the more simple and productive aspects of 
such a procedure; much chaff has been avoided. The exhaustive exploration 
of an idea, as is proper in a theoretical study, has not been attempted. On 
the other hand, it has been attempted to cover and illustrate such ideas as 
seem profitable very fully. It is hoped that the author's experience may be 
useful to workers in the fields mentioned and very probably in the Social Scienc« 
The discussion, so far, while true enough, must be tending to create 
the misconception common from the literature, i.e., that change-over experi- 
ments are to be justified by their efficiency. And a shrewd man may say he 
prefers simplicity to efficiency. In fact, one may have change-over experi- 
ments forced upon one, as it has been said "some men have greatness forced 
upon them." Thus Industry has often had change-over experiments forced 
upon it. By way of a simple example, suppose one had 4 different Treat- 
ments; suppose further that one wanted to try e'^ch of them about three times. 

One might not be able, like the classical agronomist, to assign 12 Machines 
to the problem, giving each Machine some one of the Treatments --this because 
one has, in fact, only 4 Machines. Perforce, one must do something like 
assigning 5 Treatments to each Machine, one is in a change-over experi- 
ment. Such a problem in the extreme forced itself upon the author in his 
work on paper making. There, due to practical considerations, he was 
restricted to a single great paper-making ma,chine. He was forced accordingly 



8 



7 



to arrange, a change-over experiment where a succession of bactericides was 
tried on the recirculated water of one great machine in an experiment spread 
over weeks. This "Was change-over operation in the extreme. 

The ideaj as initially proposed., of comparing the Treatments (l) and 

( 2 ) on each p^-tient can be extended to a whole sequence of designs. First 

there d: be niore than 2 Treatments, say (l), (2) and (3)j of which one 

patient tried (1) arid (2)j another (2) and (3) and a third patient (l) and 

( 3 ) . Such may be termed paired comparisons. In various forms they are in 
wide use. They afs discussed in the next section. One may go on to cases 
termed Change-over in Youden rectangles, where several, but not all. 
Treatments af® tried by each subject, patient, or machine. As discussed 
in the section, after next, one may, given 7 Treatments, try 3 on each of 

7 subjects, patients or machines. Alternatively one might try 4 Treatments 
on each experimental unit. From these one may go on to change-over latin 
squares, whef® all Treatments are tried on all experimental units. These 
are discussed below. All these Designs arise very naturally as extensions 
of the fundajtental idea of paired comparisons. The most attractive and 
easily’' handled of the designs is the Latin square--all Treatments by each 
experimental hnit^ — 'but it is unfortunately often not practical. If one 
wanted to tr/ 7 kinds of sedatives each for 2 weeks it would be inadvisable 
to use a latin square because before l4 weeks were out many of the partici- 
pants would have been lost by death or recovery. Accordingly, one would try 
a Youden rectangle which would require only 6 weeks. Again a subject, in 
order to try a Treatment fairly, may have to use it 5 weeks. Then it is 
practical to try only a few Treatments on a given subject on account of this 
consideratioh of time. Since, however, there are many people, a great deal 
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of information can be gathered fairly shortly. Accordingly^ one uses a 
Youden rectangle. In industry, not only are experimental subjects liable 
to death or discharge, but experimental results may be required very ■ 
shortly--"We must have the results within 5 weeks." Such press may make it 
difficult to try many Changes -over on a machine. 

Changes-ove r involving 2 .li-eatments per unit - In the realm indicated a 
very simple and oft—used Design is the paired comparison of Treatments 
(l)...(t) , 2 at a time. To be at all satisfactoi-y the Design should 
compare each Treatment with every other Treatment, at least once. It should 
be at once indicated that, to the contrary, there is extensive discussion, 
in the literature, on paired comparisons where a judicious subset of 
comparisons is made. An example is the writings of Cox (1958), which is 
discussed under the heading of missing data in Chap. VIII. The concept 
that it is best to make all comparisons an equal number of times is based 
on two notions. First, such comparison will be of comfort to the "practical" 
man. Secondly, any other arrangements will give rise to elaborate allow- 
ances for the various accuracy of the various comparisons. For the situ- 
ation. of 2 Treatments per unit, accordingly, the Design requires at least 
t(t - l)/2 pairs, since there are that many comparisons. Thus for t = 7 
Treatments tried on 2l Men, each Treatment to be tried for one Day, we may 
write the Design as shown in Table la. It is, of coui'-se, because t(t - l)/2 
may become inconveniently large that experimentalists take refuge in the judi- 
cious subsets indicated above. Since the two Treatments are to be tried suc- 
cessively the order of trying may be important. Then all Treatments were best 
tried equally on the first and second Days, or in the first and second Columns. 
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It would not do to assign some particular Treatment largely or wholly to a 
given Day which might be the favorable or unfavorable day. The treatment 
and day effects would be confounded. Thus^ if in Table la the Design had 
been such that Treatment (2) fell always in Day 2 and^ if that Day the 
response had been particularly favorable (2) ■would appear to considerable 
but false advantage. As matters stand Treatment (2) occurs eq.ually in Days 1 
and 2 and so any favorability of Day 2 must be balanced by the unfavorability 
of Day 1. For 21 Treatments such balance can be managed in the 21 pairs. In 
general for t , odd^ it can be managed in t(t - l)/2 pairs. The situation 
for t , even^ is discussed below. 

The fundamental issue of the Design of Table la can be seen most 
simply in the form of what may be termed a comparison table as shown in 
Ib- It is something like the schedule of games of an athletic league. 

In this comparison table, x indicates a comparison and o indicates its 
repetition in the opposite order. The form of expression depends on 
whether one says (3) vs. (4) or {k) vs. (3). Thus the x in the second 
Row and first colimm arises from Man I, - who tried both Treatment (l) 
and Treatment (2). At the same time the o in the first Row and second 
column, also arises from Man-I. Since all cells, off the principal 
diagonal, are filled once we may say the comparison table has fill of 1. 

One might, of course, employ some multiple of 21 pairs, such as 63 pairs, 
to get the comparison table filled thrice. In the business of designing 
the experiment, one would simply write out the arrangement of Table la 
three times over. It may be added that since Treatment (l) occurs thrice 
on the first Day and equally on the second Day the totality of comparisons 



O 

ERIC 



11 



Table . .1 - Comparisons of 7 Treatments in 21 pairs 



a. The Design by Men » Days and Tr.eatinents 



Mai) ■ 


Day 1 


Day 2 


Itan 


Day 1 


! 

Day 2 


!• 

Man 


Dav 1 


Dny 2 


I 


(1) 


(2) 


VIII 


'“(1) 


(^) 


XV 


(1) 


(6) 


II 


(2) 


(3) 


IX 


(2) 


(5) 


XVI 


(2) 


(7) 


III 


(3) 


<4) 


X 


(3) 


(6) 


XVII 


(3) 


(1) 


IV 


(4) 


(5) 


XI 


(4) 


(7) 


XVIII 


(^) 


(2) 


V 


(5) 


(6) 


XII 


(5) 


(1) 


XIX 


(5) 


(3) 


VI 


(6) 


(7) 


XIII 


(6) 


(2) 


XX 


(6) 


(4) 


VII 


(7) 


(1) 


XIV 


<7) 


(3) 


XXI 


(7) 


(5) 



b» The comparison table 



Treatmer 



VS . 




CO 


d) 




07 


Ce') 


(y') 


CO 




o 


o 


o 


o 


o 


o 


C2) 


X 




p 


o 


0 


o 


o 


Cs') 


X 


X 




o * 


o 


o 


o 




X 


X 


X 




o 


o 


o 


(O 


X 


X 


X 


X 




o 


o 


(-6) 


X 


X 


X 


X 


X 




o 





X 


X 


X 


X 


X 


X 


\ 



0. Differences in percentage Satisfaction achieved by 7 types of 
Treatment g;iven to 21 Men 




Treatment 



vs. 


(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) 


(1) 




-3 


-3 


-2 


+4 


-9 


-9 


(2) 


+ 3 




+11 


+4 


+5 


+2 


-2 


(3) 


i +3 

t - 


-11 




-10 


+1 


1 -15 

1 


-2 


(M 1 


1 

1 +2 


-4 


+10 




. +5 


-3 

I . . . . . 


+8 


(5) 


1 


-5 


-1 


• — 

-5 


1 ■■ ^ 

i -12 

- j 


-4 


(6) 


+9 




+15 


+3 


! 

+12 i 


0 


(T) 


+9 


+2 


+2 


-8 


+4 


1 0 

i 




Sum 


+22 


-23 


+34 


-18 


+31 


^ -3T 


-9 
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of Treatment (l) with others can be nowise influenced by the one Day being 
better than the other. 

Table lb is the situation as it might be conceived at the time of 
laying out the experiment; Table Ic shows the resuT ' after completing the 
experiment. Each Nhn stated his percentage satisfact or v/i'h each Treatment 
given him. The material question iSj of course^ the d_ffe;-ence n that 
satisfaction between the two . Treatments . Thus Ifen I gu e ^eati; nt (l) a 
percentage satisfaction 5^ greater than he gave Treatment e). .< icoi-dingly^, 

there is entered in the second Row and first Column of ^al - Ic ne value +5« 
By the same token^ there is entered in the first Row, sec I Co_ inm, the 
value -3. Treatment (2) lost to (l) by It is noteworthy th:.t Treatment 

(5) was given a higher rating than any of the 6 competitive Treatments, and 
this by 6 men. On the other hand. Treatment (2) was only once rated higher 
than any other Treatment, and the other 5 times it competed was rated 
lower. To return to the example of the athletic league, we should say that 
a team that always, or almost always, got more goals than the others was 
probably a good team. Certainly we. should prefer to put our money on team 
( 5 ) rather than on team (!)• For Table Ic the situation is, obviously, 
fairly well summarized by the sum beneath each Treatment. 

The design of paired comparisons for t , even, is not quite as simple 
as writing down all comparisons of t things 2 at a time, i.e., 

C 2 = t(t - l)/2 . The problem is that there will occur t - 1 pairs 
involving any given Treatment like (l), and it is plainly impossible to 
dispose an odd number of things equally between 2 Columns. In some measure 
Colimin effects would be confounded with the effect of Treatment (l). In 
order to arrange the Treatments sc that each occurs uhe ame number of 
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times in each Column--tlie minimum muriber of pairs or Rows is t(t - l) , 

i.e.;, twice as many as for the case of t , odd. The matter may be 

illustrated for a test on t = Treatments as follows : 

Period Period 



Row 


! 1 


2 


Row 


1 


2 


I 


(1) 


(2) 


VII 


(3) 


(1) 


II 


(2) 


(3) 


VIII 


(^) 


(2) 


III 


(3) 


(^) 


IK 


(1) 


(4) 


IV 


(^) 


(1) 


X 


(2) 


(1) 


V 


(1) 


(5) 


XI 


(3) 


(2) 


VI 


(2) 


(^) 


XII 


(4) 


(3) 



This Design double-fills the comparison table. Thus any 2 Treatments 
such as (l) and (2), are compared twice.. One might, of course, employ 
some multiple of 12 pairs, such as 56 pairs, to get the comparison table 
filled 6 times. The results would obviously be more reliable with so 
much more data. 

It seems undesirable to go further here into the question of paired 
Designs. It seems better to look at the whole field of change-over 
experiment and then return in a very thorough way to paired Designs in 
Chapter VIII. 

There is associated with paired Designs, as just discussed, and 
for that matter with all the Designs that will be discussed, what is, 
for present purposes, a degenerate class called balanced Incomplete blocks. 
These are situations where only the comparisons are of importance, and the 
order within the pairs is unimportant. Such may well be the case in the 
spacial Designs of Agronomy where the two members of a pair are simply two 
little plots of ground- Such cannot generally be the case for change-over 
O 
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experiraei -ts . Accordingly^ the following discussion will be concerned only 
with Designs in the class where the Columns are important. In such a case, 
the little distinction between n even and alternatively odd disappears , 
since there is no problem of balancing the Treatments between the 2 Periods, 
or Columns. 

Changes-over involving rather more than 2 Treatments per unit, i.g, . 5 
Youden recta ngle s — Most people must be aware of the possibilities, just 
briefly discussed, of writing paired comparisons but certainly many may 
not at all have considered the possibilities and profit of trying more than 
2 Changes-over on a given unit. Such Designs are called Youden rectangles. 

For the moment consider them as cases where the number of items per Row, 
i.e., the number of Columns is 2 < c < t , the number of Treatments. For 
instance, suppose, one wanted to test J Treatments on T Machines, each of 
which was to be subject to h of the Treatments. Then, one may write some 
Design such as that shown in Table Ila. Since this has t = 7 Treatments 
in c = 4 Columns for r = T Rows , it may be called a t x c x r oi' 

7 x^x 7 Youden. In any Row there are generated, implicitly, by a given Machine, 

6 comparisons. Thus Machine I yields the comparisons (l) vs. (2), (l) vs. 

(4), (1) vs. (7), (2) vs. (4), (2) vs. (7) and (4) vs. (7). All such compar- 
isons double-fill the comparison Table lib. Thus the present is balanced 
Design, in contrast to the class of partially balanced. In a Youden rectangle, 
at least for the type used in the present book, the number of Rows is always 
the same as the number of Treatments although the number of Col'umns may vary. 
The Rows in this Design might, in the widely used terminology that originated 
in Agronomic experimentation, be called blocks. The term has, however, little 
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Table II - Comp::. Ison of T Treatments in . sets of .H. 

The 7 y,Uy7 Youden 

a. The Design hv Machines and Toy Periods, 



Period 



Machine | 


1 


2 


3 


4 


I 


(1) 


(2) 


(4) 


(7) 


II 


(2) 


(3) 


(5) 


(1) 


III 


(3) 


(4) 


(6) 


(2) 


IV 


(4) 


(5) 


(7) 


(3) 


V 


(5) 


(6) 


(1) 


(4) 


VI 


<6) 


(7) 


(2) 


(5) 


VII 


(7) 


(1) 


(3) 


(6) 



~b. The comparison table 



Treatment ’ 



VS . 


(1) 


(2) 


^ (31 _ 


(4) 


(5) 




All - 




(1) 




oo 


oo 


oo 


oo 


oo 


oo 


— 


^ 

(2) 


XX 




oo 


oo 


oo 


oo 


oo 


(3) 


XX 


XX 




oo 


oo 


oo 


oo 




(4) 


XX 


XX 


XX 




oo 


oo • 


oo 




(5) 


XX 


XX 


XX 


XX 




oo 


oo 




_-r— ^ ^ 

(6) 


XX 


XX 


XX 


XX 


XX 




oo 




^ 

■ 


XX 


XX 


XX 


XX 


XX 


XX 







c . Experimental results 




Period 



Machine 




1 




2 






3 






4 


I 


(1) 


272.9 


(2) 


302. 


4 


(4) 


349. 


1 


(7) 


281.1 


II 


(2) 


384.4 


(3) 


424. 


■ 1 


(5) 


372. 


0 


(1) 


316.4 


III 


(3) 


292.9 


(4) 


356. 


,4 


(6) 


374. 


2 


(2) 


198.2 


IV 


(4) 


530.2 


(5) 


425. 


.2 


(7) 


309. 


9 

J 


(3) 


464.7 


V 


(5) 


304.1 


(6) 


5ip. 


.6 


(1) 


412. 


2 


(4) 


417.4 


VI 


(6) 


319.0 


(T) 


474 


.3' 


■ (2) 


4o4. 


.0 


(5) 


221.9 


VII 


(T) 


457.8 


(1) 


337 


.9 


(3) 


327. 


.1 


(6) 


4o3.4 



IG 



Table II (continued) 



15 



d. Comparison table results 



Treatment 



VS . 


( 1 ) 


( 2 ) 


( 3 ) 




( 5 ) 


( 6 ) 


( 7 ) 


( 1 ) 




+29.5 
+ 68. 0 


+108.3 

- 10.8 


+76.2 

+ 5.2 


+ 55.6 

-108.1 


+ 98.4 

+65.5 


+ 8.2 

+119.9 


( 2 ) 


-29.5 

- 68.0 




+ 40.3 

+94.7 


+ 46.7 

+ 158.2 


- 12.4 

- 182.1 


+176.0 

-85.0 


- 21.3 

+70.3 


( 3 ) 


-108.3 

+ 10.8 


- 4 o. 3 

-94.7 




+63.5 

+65.5 


-52.7 

-39.5 


+81.3 

+76.3 


-154.8 

+130.7 


(4) 


-76.2 

- 5.2 


- 46.7 

- 158.2 


-63.5 

-65.5 




-105.0 

- 113.3 


+17.8 

+ 93.2 


- 68.0 

- 220.3 


( 5 ) 


-55.6 

+108.1 


+ 12.4 

+ 182.1 


+52.7 

+39.5 


+105.0 

+ 113.3 




+206. 5 
. +97.1 


-115.3 

+252.4 


( 6 ) 


-98.4 

-65.5 


-176.0 

+85.0 


-81.3 

-76.3 


-17.8 

- 93.2 


-206.5 

-97.1 




+155.3 
^ +54.4 


( 7 ) 


- 8.2 

-119.9 


+ 21.3 

-70.3 


+154.8 

-130.7 


+ 68.0 

+ 220.3 


+115 . 3 
-252.4 


-155.3 
-54. 4 




Sum 

Mn. 


-515.9 

-36.8 


-187.9 

- 13.4 


+62.2 

+ 4.4 


+810.9 
+ 57.9 


-998.2 

-71.3 


+617.4 

+ 44.1 


+211.5 

+15.1 
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meaning and no utility in change-over experiments. Accordingly^ they are 
referred to more conveniently as Rows , from the point of view of writing out 
the Design. 

In order to make the nature of the Design and the analysis abundantly 
clear j an actual experiment is reported. There were 7 ways of setting up 
Machines and 4 of the ways were tried on each of 7 Machines.- This took 4 
Periods of about 10 days on each Machine. The resulting yields are shown in 
Table lie. Finally, in the comparisons of Table Ild, it can be seen how the 
Treatments, or sets-up, for the Machines, compared within a given Machine. 

Thus Treatment (l) gave 29.5 ib. less than ( 2 ) on Machine I; by the same 
token ( 2 ) gave 29.5 lb. more than (l) on Machine I. Treatment (l) gave 68.0 
lb. less than (2) on Machine II, etc. All in all Treatment (l) gave 515*9 
lb. less than the Treatments (2) throrigh ( 7 ) with which it occurred on the 
same Machines, I, II, V, and VII. (There is no question of comparing Treat- 
ment ( 1 ) to other Treatments on Machines where (l) was not tried.) Similar 
totals are formed for each Treatment (l) throiigh (7)* We must be struck by 
the fact that Treatment (4) did better than any other Treatment except ( 5 ) 
on all Machines on which it was tried and got a total of +8l0o9« From these 
totals averages may be struck (dividing by l4 and not 12 as one might have 
expected). From this we learn that Treatment (l) gave 56.8 lb. less on the 
average than all Treatments (including itself). It should nowise be supposed, 
of course, that the above extensive but primitive piece of arithmetic is 
intended as an example of how such a louden rectangle should be analyzed in 
practice. This arithmetic is presented simply to justify and recommend the 
Design. Methods of analysis to be used in routine work are presented later; 
they are much less laborious and much surer methods. 

O , -i 
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It is also possible to try 3 Treatments on each of 7 Machines, when 
there are 7 Treatments to be tested, if one writes some Design, such as: 

Period 



Machine 


1 


2 


3 


I 


( 1 ) 


( 2 ) 


(U) 


II 


( 2 ) 


(3) 


(5) 


III 


(3) 


(U) 


( 6 ) 


IV 


(U) 


(5) 


(7) 


V 


(5) 


( 6 ) 


( 1 ) 


VI 


( 6 ) 


(7) 


( 2 ) 


VII 


(7) 


( 1 ) 


(3) 



This Design preserves the virtue of Table la, that each Treatment occurs 
the same number of times on each Day, i.e., in each Column. Also if 
Machine I gives some production for Treatments, (l), (2) and (U), there 
are available the 3 comparisons (l) vs. (2), (l) vs. (U) and (2) vs. (U), 
free of the differences that can occur from Machine to Machine, i.e., 
within a given unit or Machine. The 21 such comparisons , from the present 
Design, just fill a comparison table like Table Ib. The Design gives rise 
to a once-filled table of comparisons. The above Design, with 7 Machines 
during 3 Periods can be called a Youden rectangle with 7 Treatments (t ) 
in 3 Columns (c) for 7 Rows (r) , or it may be called a 7x3x7 Youden. 

So far as actual use of the above 7x3x7 Design is concerned, when there 
are many experimental units, it may be repeated 3 times on 21 of them 
so that a good deal of information may be gotten conveniently. 

It is impossible to write a Design, i.e., to try 7 Treatments 
on each unit 5 times and to satisfy the condition that all horizontal 
comparison, i.e., within Rows, should be made an eq^ual number of times 
in 7 Rows. We might call this a 7x5x7 Design. Just where it is pcssible 
to write Youden rectangles is discussed in detail in Chap. III. He./ it 
is possible to write them is discussed in Chap. IV. 
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For general discussion of Youden rectangles the reader may refer to 
Youden (1951);, to Cochran and Cox (1957)^ or to Fisher and Yates (I967, 27- 
3 l). The reader of the above cited works will find an elusive element of 
difficulty^ if his practical experience is indeed of the change-over type. 

This difficulty is that tne entire corpus of experimental Design rests on 
and reflects its origins in the field trials of Agronomy. The reader will 
find Youden rectangles are recommended for problems on^ for instance;, litters 
of animals where it is required to try about I9 Treatments on highly consis- 
tent litters of about 5 • Such designs are recommended for laboratory and 

technological processes where there is a limited number of Treatments pos- 
sible on a group and varietal trials where there is a large number of varie- 
ties. These recommendations are essentially in terms of field trials 
involving contiguous plots and seem a little odd if one is thinking essen- 
tially in terms of change-over experiments. Writers generally^ within a 
classical type of experimental design^ as in Agronomy^ think of Youden 
rectangles as a means of getting smaller blocks and thus controlling varia- 
tiility. Sometimes ^ we are more interested in foreshortening the time required 
for an experiment. Even in change-over experiments^ however^ it may be argued 
that it is best to try only a few Treatments on a subject because over a short 
time he is presumably more consistent in his responses than he is over a long 
time. It can also be argued that insofar as subjects change variously with 
time^ the short experiment is the better. 

As was previously discussed^ in connection with paired comparisons, each 
Youden i-ectangle is exactly pa,ralleled by its balanced incomplete block. The 
distinction is that in Youdens the Column in which a symbol occurs is 
important, whereas it is not so in e. balanced incomplete block. To put the 
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matter otherwise ^ a Youden rectangle becomes a balanced incomplete block if 
the s3mibols within a Row are randomly permuted. The Design of Table Ila, 
for "(yhyCJ , thus becomes j for instance; 

Period 



Machine 

J 


1 

i 


2 


3 


4 


1 

I 1 


i (2) 




(1) 


(7) 


II 


(3) 


(1) 


(2) 


(5) 


III 




(6) 


(2) 


(3) 


IV 




(3) 


(5) 


(7) 


V 


(6) 


(5) 




fl) 


VI 


(7) 


(2) 


(5) 


(6) 


VII 


(6) 


(1) 


(3) 


(7) 



It will be noted that the Treatments on each Machine are exactly the same as in 
the corresponding Youden rectangle but they do not necessarily occur in the 
same Period. The Design obviously has not balanced Treatments against Periods. 
In the analysis the effects of only Machines and Treatments would be considered. 
Ifj of course j the Columns of a Youden rectangle prove^ in some sense, unim- 
portant, this class degenerates into balanced incomplete blocks. The same 
Design may be used but analyzed either as a Youden or as a balanced 
incomplete block. Note that any Youden Design can be used as balanced 
incomplete block Design but the reverse is not true. 

Double Youdens - There exists an extension of the siniule Youden rectangle, 
as first discussed, which may be termed the double Youden rectangle. It 
has most of the general properties of the well-known simple Youden rectangle. 

It has all Treatments equally represented, i.e., twice, in each Column. 
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The horizontal comparisons, i.e., within a Row, fill each cell in a compari- 
son table an integer nuimber of times. It differs only in that t Treatments 
req_uire a Design of 2t Rows. In general it may be characterized as 
t X c X 2t . Such a Design could, of course, be used in experiments that 
are not change-over but are simply spacial, as in Agronomy. They have been 
so used by Cochran and Cox (1957) with the appellation of Type V, The neces- 
sity for such a Design arises because, as has previously been indicated, it 
is not always possible to write a Youden rectangle which might be convenient 
for an experimental program. Thus one cannot write a 7x5x7, i.e., the number 
of Treatments, t = 7 , the number of Columns, c = 5 , and the number of Rows, 
r = 7 , in a balanced Design. Thus in terms of a comparison table, like 
Table Ilb, there would be 10 comparisons per Row or 70 in all to fill 21 cells 
of the comparison table (below the principal diagonal thereof). Accordingly, 
some would, at best, be filled thrice and some four times.' The non-existence, 
for present purposes, of 7x5x7 is not important, in a practical way, because 
one can write 7x5x7, 7x4x7 and 7x6x7 (as will appear in the next Section). 

The issue does, however, become, important if one has 9 Treatments because it 
is then impossible to write any Youden rectangles at all, except the special 
large case of 9x8x9 (Yates rectangle) in 8 Cokjmns or the even larger latin 
square (9x9x9). This is very unfoi-tunate because there always seems to be a 
lot of experiments with 9 Treatments. The practical difficu.lty can, however, 
be met by writing the double Youden rectangle 9x4x18, as in Table III. This 
only requires 4 Periods or Columns. Just when it is possible to wite Youden 
rectangles or double Youdens can be discovered from Table IV which shows a.1 1 
possible Youden situations, single and multiple, for any number of Treatments 

O 
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Table XiX Con'peri son of 9 Treatn\cnt5 In sets of 4 
iTie 9x4k18 Double Youden 



a. The Design by Groups and by Periods 



Group 


1 


Period 

2 


3 


4 


1 


(1) 


(2) 


(4) 


(8) 


11 


(2) 


(3) 


(5) 


(9) 


HI 


(3) 


(4) 


(6) 


(1) 


IV 


(4) 


(5) 


(7) 


(2) 


V- 


’ (5) 


(6) 


(S) 


(3) 


VI 


(6) 


(7) 


(9) 


(4) 


VII 


(7) 


(8) 


(D 


(5) 


VIII 


(8) 


(9) 


(2) 


(6) 


IX 


(9) 


_ Cl) 


(3) 


(7) 


X 


<1) 


(6) 


(3) 


(2) 


XI 


(2) 


(7) 


(4) 


(3) 


XII 


(3) 


■(8) 


(5) 


(4) 


XIII 


<4) 


(9) 


(6) 


(5) 


XIV 


(5) 


CD 


(7) 


(6) 


XV 


(6) 


(2) 


(8) 


(7) 


XVI 


(7) 


(3) 


(9) 


(8) 


XVII 


(8) 


(4) 


(1) 


(9) 


XVIII 


(9) 


(5) 


<2) 


(1) 



b. The comparison stable 



Treatment 



VB. 


Ujp -- 


-- (2) 


C31 j 


^(41 i 


(5) 




(6) 


(7) 


(8) 


1 C9) 1 






ooo 


OOO j 


OOO • 


jaoo 




OOO 


OOO 


OOO 


j ooo 


(U 1 


: 




ooo I 


ooo j 


ooo 


1 

J 


r 

\ 


OOO 


ooo 1 


ooo 


■4— ‘ 
j ooo 


IlLJ 


i MZ i 


1 xyy 




ooo 1 


ooo 


1 

i 


\ ooo 


ooo t 




: ooo j 




xxy 


xyy 1 




ooo 




ooo 


ooo j 


ooo 


! ooo 1 


m-J 


1 m 1 


xxy 


xxy • 


^yy ! ^ 






ooo 


ooo 


ooo 


1 ooo 


lai 


■ 


- 


xxy j 




xyy 




h - ^ ’ 


! ooo 


ooo 


T ooo ! 


iZl_J 


XKV ■ 1 


1 ■xyy. 


xyy 1 


xxy 1 




1 


. ^^<yy I 




ooo 


1 OOO I 


(8) 


xxy 


x:cy 


^yy i 


xyy i 


xxy 


1 


xxy j 


xyy 




r ooo i 






xxy 


XXV ! 


xyy 


..m 


i 


xxy 


xxy 


xyy 






up to t = 56 in any number c < t - 1 of Columns. As nright be expected, 
the multiple Youdens have their parallel balanced incomplete blocks. 

Table Ilia shows the Design for Table Ilb sets out the compar- 

ison table, i.e., the compaxisons within Rows. Then we may check off the 
comparisons in the first 9 Rows with an x and in the last 9 Rows 
with a y .Thus Treatment (l) is compared with Treatment ( 2 ) once in the 
first half, i.e., in Row (Group) I and twice in the second half, i.e., 
in Rows X and XVIII. So its comparison shows xyy . The counter compar- 
ison of ( 2 ) with ( 1 ) may be again, as in Table I, indicated by an o. This 
comparison Table Illb shows that the 9xUxl8 gives rise to a thrice-filled 
table of comparisons. If the first half had been used alone some comparisons 
would have been made once and some twice and the same may be said of the 
second half. As things have been worked out, however, the two halves comple- 
ment each other and all comparisons are made thnice. 

These double Youdens may not only be useful when, for some value of 
t , like 9 , there exists no single Youden Design, but also when they 
require a smaller number of Columns than the single Youden. Thus it is 
shown in Table IV that for 25 Treatments one can write the single Youdens 
25x9x25 and 25x16x25 but it may nonetheless be more practical to employ 
the double Youden 25x4x50. 

To go somewhat beyond the idea of double Youdens, it may be noted that 
there do exist various classes of multiple design where the number, r = gt , 
of Raws invol.ves g > 2 but still an integer. Thus it might be said that 
the case of a triple Youden, Yy.2x21, f = 1 , has already been shown in 
Table I. While in a theoretical way we might get a variety of integers, it 
seems hardly worthwhile to consider cases other than g = 2 , i.e., what the 
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writer terms "double Youdens." The exception is the case of paired compari- 
sons c = 2 ^ where we may go to quite high multiples, or values of g > 2 . 
Cochran and Cox (I957), it may be noted, do show multiple Designs beyond the 
double. 

Yates rectangles -■ A special class of Designs was first suggested by Yates 
(1936), where r , the number of Rows, is the same as t , the number of 
Treatments, but c , the number of Columns is always t - 1 . In these 
Designs every Treatment must, of course, occur in every Cn , Furthermore, 
each Rovr must contain all Treatments but one and that one r.r.s be missing in 
no other Row. Yates rectangles may be conceived as simply ‘.ning down all 
combinations of t things t - 1 at a time, i.e., C^ ^ Rows, and then 

permuting within Rows until the condition that each Treatmc. occur once and 
only once in each Column be met. Such Designs can be written for any value 
of t . An example is the 7^6x7 De^sign as follows ; 



Column, 



Row 


1 


2 


3 




5 


6 


I 


(1) 


(2) 


GO 


(7) 


(6) 


(3) 


II 


(2) 


(3) 


(5) 


(1) 


(7) 




III 


(3) 


(^) 


(6) 


(2) . 


( 1 ) 


e) 


IV 


(^) 


(5) 


(7) 


(3) 


(2) 


(6) 


V 


(5) 


(6) 


(1) 


(^) 


(3) 


(7) 


VI 


(6) 


(7) 


(2) 


(3) 


(0/ 


(1) 


VII 


(7) 


(1) 


(3) 


(6) 


(5) 


( 2 ) 



The comparison table is always filled t - 2 times. This Design fills the 
comparison table 5-fold. 
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These rectangles due to Yates (1936) are of great interest historically 
because they anteceded Youden Designs in general. Yates had in mind 
not Change-over experiments but those more like Agronomic experiments where 
the observations were made on contiguous plots of land. These Yates rec- 
tangles are not of general utility because, among other things, they are 
overshadowed by the closely related latin squares which will be discussed 
next. There is, however, one exception and that is in problems involving 
Carry-over, which will be discussed below, and which makes latin squares 
with t odd gui :e awkward, whereas the associated Yates rectangle is very 
well behaved. It may be preferred to use the Yates rectangle. 

Latin squares - A very special class of change-over Designs are those where 
the number of Rows and Columns is the same as the number of Treatments . 

These may be written t x t x t . They are called Latin squares. In these, 
every Treatment must occur in every Row and in every Column. The comparison 
table is always filled t times. This well-known Design is abundantly 
illustrated in the remainder of the present book. The first case shown 
is that of Table VI. 

Latin squares are of great general untility. They are comparatively easy 
to design. They are easy to analyze. Latin squares are of the greatest inter- 
est historically because they were among the things that Sir Ronald Fisher 
gave us when he inaugurated experiment al design in the early 1920's. Origin- 
ally, and in most of the current writing, latin squares arise typically as 
contiguous plots of land, rather than as Change-over experiments, but there 
seem to arise fejw difficulties on account of this background. 

The historic order in which things arose was first the latin square, 

for practical purposes by Fisher in I 925 , then the Yates (1956) rectangle, 

O 
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and then the Youden (1937) rectangle. Properly we should perhaps speak 

of Youden squares in contrast to latin squares, hut that name has been so 
firmly established by the illustrious Sir Eonald Fisher, that it must be 
retained. To the contrary, in the literatiore Youden rectangles proper are 
often spoken of as Incomplete latin squares. This term arises because 
the latin squares anteceded the Youdens. In a sense, this is a fair des- 
cription because a Youden rectangle may always be completed to a latin 
square. On the other hand, it .3 nowise true that a latin square can 
always be reduced to a Youden r -tangle. ComiLonly, is quite impossible 

to choose any set of columns f: om the latin square and get a Youden 
rectangle. It is, of course, fair to call a Youden square, or latin 
square, complete in the sense that a given Row contains all Treatments 
once and once only. On the other hand, a Youden rectangle, c < t , is 
incomplete in the sense ‘that a given Row contains only a fraction of the 
Treatments. 

The usual textbook discussion of latin squares, arising as it does 
from spacial rather than Change-over experiments, discusses their character 
in terms best forgotten in the present context. They are said to possess 
a "double control," i.e., they are arranged so that systematic effects in 
the Rows and Columns do not affect the comparison of Treatment estimates . 
While this is true enough, it were best forgotten so far as change-over 
experiments are concerned. For them, just as for any other Youden 
{ c < t ) Design, Column effects are eliminated automatically from the 
Treatment comparisons because every Treatment occurs in each Column and 
their effects are quite unconfounded. The matter is best conceived as 
that s?f differences within Rows filling a comparison table t times. 
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It may be suggested in a gene.", al -way that the latin square ar3 ses 
simply as a special case txtxt^ of the Youden type txcxt^ of Designs. It 
nonetheless nas many special properties. It may be considered as an up;,’3r 
boundary of the Youden Designs in a "very general sense. The latin squase 
also is inrortant since several rules as to existence of Youdens turn c i 
it. These rules "will not be discussed here further^ however. 

The reader will encounter in the literature much difficulty in the 
analysis of Youden rectangles and even more when he attempts to extend -t 
to Change-over experiments on account of the reverse order in which the 
Designs arose— from special case to general case. The literature attempts 
the form of the analysis of variance that Fisher derived for the latin 
square. With the development of the field, later writers have attempted 
to generalize the analysis of all types of design into the form of analy- 
sis of variance. This Procrustean effort is of dubious value particularly 
when one gets to the analysis of change-over experiments. The arithmetic 
becomes extremely heavy and the interpretation muddled. Accordingly, it 
seems best to recast the analysis of data from Youden rectangles in a 
form more natural, more meaningful and, in certain circumstance^ more 
easily calculated. .This form is, of course, applicable to latin squares 
for which it about ties with analysis of variance. 

The latin square, like the previous Youden rectangles, has its degener- 
ahe form, when the character of the Columns is supposed trivial. This is 
known as randomized blocks. This Design is of considerable importance in 
laying out trials on plots of land but of no interest in Change-over 
experiments . 




27 



Metalatin Des-gns - We shall c insider only very briefly c^^eS where the number 
of Columns e::ceeds the nunlsr -'f Treatments, i.e., where Q > t . Beyond 
latin square:. one may, at leas': theoretically, go on to <:;^ses "Where each 
experimentaj. unit (patient, Subject or Machine) try all Treatments and try 
some of them more than once. Per instance, each subject /^ight try all Treat- 
ments twice, in a rather simple-minded design. For such there Seems to 
exist no name; therefore, '^e~ us coin the term of metalat^h rectangles. 

There seem to be 5 types , i'ype III of Cochran and Cox (l95f ), where the 
niimber of Columns is c = mt - l(m >1); their Type IV where c = mt + l(m > O) , 
m being an integer; and a nameless type which arises giveh t X c x t , c 
being such that c* = c - t g- .es rise to a Youden Desigrij iti the sense of 
the present book, t x c' x t . In these, some Treatment ^uSt OccUr more 
than once in a Row and therefore be compared within the ReW with itself. In 
the comparison table the cells of the principal diagonal ^re to some extent 
filled--in the comparison table for c < t these cells ^rg siAPty- Approach- 
ing the problem from another direction, one will find such hesiSns discussed 
as latin squares with exti'a plots. 

There is only one place where the use of metalatin D^^ign^ seems possi- 
bly justified, i.e.,' the case of tx(t + l)xt . These ar^ mehtioixed very 
favorably by Patterson and Lucas (I962). They favor a latih square where 
each Treatment is followed by every other Treatment and th®h by repeating the 
last Column so that it is also followed by itself. Such design makes Treat- 
ments and Carry-over completely orthogonal but at the expanse c'f confounding 
with the Rcw. It is possible that some such Design would avoid the difficul- 
ties in Qiange-over referred to later, of writing latin sqUarsgi With t odd , 
but the matter is not explored iu the present book. 
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The Designs we have .. ei metalatin, i.e,^ of the present general 
type except that c > t , • not be discussed much further in this book 
so that perhaps a few ge.ie:.- -.! remarks are in order here. Metalatins may 
conceivably be useful in ^ unusual situations where one is poor in 
experimental units but cc~ ..tively rich in time. Such a case mighty for 
instance, arise in a pape: r_l on an experiment on 3 great paper 

machines, which are all t* are in a paper plant. Accordingly, one might 
try out 3 bactericides ov . lore than 3 periods. The case is some- 
what forced and the whole ,_i..ss seems so far outside all probable experi- 
ence that it will not again be discussed beyond this section. The Design 
3x5x3 j taken from Cochran and Cox (l95Tj their plan 13. l6 of their Type III);, 
is 



Column 



Row 


1 


2 


3 


4 


5 


I 


(1) 


(2) 


(3) 


(2) 


(3) 


II 


(2) 


(3) 


(1) 


(1) 


(2) 


III 


(3) 


(1) 


(2) 


(3) 


(1) 



The resulting comparison is 



Treatment 
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(3) 


(1) 


XXOO 


oooo 
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(2) 
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oooo 
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(0 
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The historic limitations of experimental design - It so happened that the 
necessity for clear thinking with regard to experimental design and the 
analysis of experimental data were first realized in Agronomic work at 
Rothamsted Experimental Station. As a result the terminology of experi- 
mentation has an Agronomic flavor. In a most serious way, the whole realm 
of thinking is limited and stilted by the circumstances of Agronomy in the 

1920* s. 

It should be understood that the agronomic experiment is peculiar in 
that in a general way it consists of units of area upon each of which, in a 
usual way, only one Treatment is tried. One tries only one fertilizer on a 
given piece of land. These small plots are usually clustered in compara- 
tively homogeneous groups called blocks. There may be great variability 
from block to block although ideally but little within. The idea of the 
Block or of the Row, as we handle things, is very important. It is the 
dimension in which we accept chance variability. We anticipate there will 
be much more variability smong Rows than within them. A contrast to Change- 
over, in behavioral work, that is analogous to the plots and blocks of 
Agronomy is what is often called matched panel operation. One Treatment 
is given to one group of men and another Treatment to another group, 
nhere are, say, two such groups. An effort is itiade to get men of about 
the same age, background, etc., matched or balanced into the 2 groups. 

Such endeavors generally seem to work out poorly. The experimental control 
of a change-over experiment seems to work out better. 

The reader with a background in statistical experimentation will be 
surprised that the present book gives but little attention to the 
arrangement of Treatments, as compoundings of various factors etc., but great 
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attention to the evaluation of Treatments regardless of their origin. 

The writer's experience has been that his great problem has been to 
discover the actual result of his Treatment — how people react to such and 
such a Treatment. How much steel did come from the use of each Oil? 

These facts require more than careful and abundant observation- they re- 
quire the careful design with which this book is preeminently concerned; 
they require careful allowance for probable differences among the experi- 
mental units. The facts having been clearly discovered, the particular 
policy that should be pursued as a result of the experiment is often 
patent. There ’is, on occasion, necessity to break treatment variability 
up, as has been done in each of Chapters V through VIII in connection with 
various types of problem. This is essentially the partitioning of treat- 
ment effects that looms so large in the classical, analysis of variance. 
Indeed, Table XXXVT is devoted to such partitioning. It will, however, 
be noted that the numerous examples of the present book are almost entirely 
concerned with the question, in fact, of what was the response to various 

f- 

Treatments in simultaneous trials. 

Finally, experimental practice and analysis are still heavily influ- 
enced by the fact that they were directed towards the use of desk calcu- 
lators. A science carries its rudimentary aspects in the same way that 
animals carry rudimentary organs. One can indeed still find in statistical 

texts elements from the pen-and-paper days preceding the desk calculator 

♦ 

early in this century. In fact, we have the electronic computer and should 
shape our work for its use. The matter of form of analysis will be taken 
up fully in the later chapters. 
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II. Exploration of Youden field 
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lie general chaj-acte r of Youden Designs - For the type of Design indicated 
in Chapter I, we may write in a formal way that it involves t Treatments, 
applied to c Columns in r = gt ( g an integer) Rows. For c < t , no 
Treatment is repeated within a Raw, whence each Treatment occurs g times 
in each Column. In order that the comparison table, in the sense of 
Chapter be filled an integer number of times, the number, 

2rCg = rc(c - l) 

of comparisons within a Row over all Rows must be a whole multiple of the 
total , 

2Cg = t(t - 1) 



number of combinations in the comparison table, i.e., the schedule of 
paired comparisons. The integer fill is then 

f - rCg/Cg 

= rc(c - l)/t(t - 1) . 

The value r is generally chosen so that f is minimal. The case of 

r = t IS, of course, that of the usual (single) Youden. Then, of course, 
we get the simplification 

f = c(c - l)/(t - 1) . 

Cases where r = gt , g an integer, greater than 1, but minimal, are what 
we have termed multiple Youdens. We are particularly interested in the case 
of g = 2 ^ which is here termed a double Youden. 
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The term Youden is used in the present book in the somewhat restricted 
sense of Designs that seem to have proven useful and easily useful. They 
are restricted to situations where the numbers of Rows,, typically subjects, 
and corresponding to blocks of the classical experiment in Agronomy, is 
equal to the number of Treatments. There is also a special class where the 
number of Rows is twice the number of Treatments. Each Treatment appears 
the same number of times (once or twice, according to type of design) in 
each Column. Very importantly, each Treatment is compared with each other 
Treatment the same number of times within some How. The number of compari- 
sons within Rows is called the fill. The term Youden is used somewhat more 
broadly than usual in the literature, to include not only the common cases 
where the number of Columns is less than the number, of Treatments but also 
cases where Columns equal Treatments. 

There exist, in the literature. Designs where the number of Rows 
is less than t , whence a given Treatment cannot be represented in every 
Column. There are also Designs where the number of Rows is greater than ' 
the number of Treatments, but not an integer multiple. In the terms of 
the immediately preceding discussion, g is not an integer. Such Designs 
are unhandy to execute and put an unnecessary strain on one's faith in the 
algebraic interpretation. It seems idle to get into such unnecessary 
complications. It were better to spend our time understanding fully, 
and familiarizing ourselves with, the more limited. type of Designs, 
covered in the present book. The present book excludes the metalatins, 
where c > t . 
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Latin squares and Yates rectangles - It is always possible to write a 
latin square, which requires t Rows. Then g = 1 . Then from Equ. (4), 
since c = t , f = t . Similarly, it is always possible to write a 
Yates rectangle, which requires t Rows and c = t - 1 , whence from 
Equ. ( 4) , f = t - 2 . 

Youden Designs, c < t - 2 , that may exist - In order to find what 
Designs are possible, for a given number t of Treatments, one need only 

consider the value of f in Equ. (4) for any value of c (with that t ). 

Then a single Youden can exist for cases where f is an integer. Double 
Youdens are cases where f comes out ,3;i l»5j 2.5, etc., and then it is 
necessary to make g = 2 . Triple Youdens are cases where f comes out 
a multiple of l/3 and then it is necessary to make g = 3 • Using thus 
Equ. (4), Table IV was construcT.erj >, Il'is table shows for t through 
36 all single and double Youdens than can possibly exist and for t 
through l6 all triple Youdens. For each Design, the fill, f , in the 
appropriate comparison table is shown. It should, of course, be realized 
that the conditions considered in Table IV are necessary but not sufficient. 
Only for the cases shown can there exist a Youden rectangle, but not for 
all cases has a Design been written. 

It will be noted in Table IV that if any Design, single, double or 

triple, for t Treatments can be written in c Columns, then for the same 

t Treatments, one can be written in t - c Colurms . One may term two 
such Designs complementary. The procedure' for so doing is discussed in 
Fisher and Yates ( 1967 : 26 ). 
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Table IV - Possible Youdeniah arran^ertienta v/l t h given number t 
of Treatments, c of Columna > resultlnp. In fill of f 



Youdena slnpile or proper (excluding: Yates rec t an^^lea agd latl n 



squares), all possible up to t - 56 
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One can only suppose that the possible Designs of Table IV ■would soon 
be obvious to anyone who looked at all closely at the present field. Such 
a list is given, over somewhat different range from that of Table IV, by 
Fisher and Yates (19&I )• They show the cases for which it has been proven 
that no Design is possible. Often, however, the reader may be told the 
Designs that are kno'wn but not those possib3.e. In this sense, some are 
missing even from Cochran and Cox (l95T )• They show in their list of 
plans all the single loudens up to the case of t = 21 and occasional 
higher valxies of t - They omit Designs that exist for t = 25 and 51; 
that possibly exist for t = 27 , 54, 55 and 56 ; and that might be expected 
but are proven not to exist for t = 22 and 29 . A n'umber of other ■writers 
give lists but these seem to refer back pretty generally to Cochran and 
Cox. Many more Designs are added in the present book, but even here 
Designs remain unfound. 

It is probably surprising that when t < 56 how few single Youdens 
are even possible from Table IVa. There t is most commonly odd, 
because then it is much easier to satisfy Eq.u. (4). There are even fewer 
double Youdens because for them it is almost necessary that t be some 
multiple of 4 plus 1. Such limitations are not, however, important in 
practice. For instance, with 10 Treatments to test, one could be tried 
twice, or some other 11th could be found, and so the very convenient 
Youdens of 11x5x11 or 11x6x11 would become applicable. 

Single Changes -over or paired comparisons - Paired comparisons, i.e., cases 
where only 2 Treatments are offered in succession to each participant or 
machine initiated the entire present discussion. They remain of peculiar 
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practical importance. Only in tlieir case are we interested in Designs 
where g is larger^ and sometimes considerably larger, than 2. Then, of 
course, it is always possible to write a Design. For t Treatments it 
is only necessary to write r = Cg Rows to get all comparisons. This 
indeed does for t , odd, although if it is also required that each 
Treatment occur equal3y in each of the 2 Columns it is necessary to write 
r =20^ ROWS. Under these circumstances, paired comparisons are always 
filled once for t , odd, and twice for t , even. Chapter VIII is devoted 
to the consideration of such paired comparisons and includes some discus- 
sion of their design. 
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III. The Carry-over of Treatment effects 
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The gene ral c CaiT;, ’Over in Change-over experiments - Change-over 

experiments while admirable in many respects suffer from the problem of 
the Carry-over of effects from one period of Treatment into at least the 
following period under another Treatment. For example, in the classical 
field of Animal Husbandry where a cow’s lactation may be subdivided into 
three Periods each under a different diet, the effects, such as vitamin A 
content, of one Period must persist into the following Period. Likewise, 
in an industrial experiment on the use of bactericide in the recirculated 
water of a paper machine, the bactericide of the 2nd period may persist 
into the 3rd period. A similar problem arises when people are given a 
series of Treatments. The character of one Treatment tried, for example, 
in the ,2nd week, may influence their response to Treatment tried in the 3rd 
week. The matter may be one of simple physical persistence of Treatment or 
it may be a matter of changed attitude on the part of a patient. It is 
often easy enough to show experimentally that such Carry-over occur without 
being able to judge whether the effect is physical or psychic. While such 
problems seem to have been first considered in feeding problems of Animal 
Husbandry, they occur, however, widely and clearly, in studies made in many 
fields. The carry-over effect present is usually boldly ignored, often to 
the total confusion of the experimental results. 

The possibility of Carry-over is very important because it influences 
not only the analysis of data from change-over experiments but their design. 
Occasionally one wants information on Carry-over per se — how long does a 
Treatment effect persist? More commonly one wants to free the estimates of 
direct Treatment effects from Carry-over with which they may be confounded. 
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Even the latter _r not alvays done. It may be sufficient to balance carry- 
over so that it affects all Treatments equally. Certainly it is 
folly to have a given Treatment often or even always preceded by some 
other Treatment which may cast a heavy shadow. Yet the literature is full 
of such designs. The balancing of carry-over effects can, moreover, be 
usually done at no experimental!- or monetary cost — it is simply a matter 
of arrangement of Treatment sequences. 

The general field of Change-over experiments has been reviewed by 
Patterson and Lucas (1962). Their review allows for what seems to the 
writer extremely complicated Design; it allows for cases where say a number 
of subjects are first divided into subgroups which are comparatively homo- 
geneous within themselves ar.vd on all this is the Design built. The writer 
thinks that perhaps such complexity has unduly burdened the application of 
their techniques. Certainly the writer has had trouble enough. to’ get the 
more simple of their Designs, as discussed in the present book into use. 

Even then comparatively simple Designs have suffered from men disappearing 
or at least failing to complete their assignment. 

In the previous discussion the idea of Carry-over effects from an 
hnmediately preceding Period is involved rather than, say, from some yet 
earlier Period. Indeed the following discussion is almost entirely in terms 
of the immediately preceding Period. In fact, very commonly one can find 
traces of Carry-over for 2 Periods. It usually seems to be much the same 
as the Carry-over of immediately preceding Period but weaker. Theoretically, 
and' to some extent practically, one may be plagued by the Carry-over 
extending back several weeks in an experiment. 
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Carry-over in a simple non-Youden situation - A clear illustration of 



Carry-over comes from a very simple experiment for v-hich data and Design 
are shown in Table Va. Treatment (l), which, as will appear, proved in- 
ferior, was tried against regular Treatment (2). This Design does involve 
Change-over but is outside any of our regular Youdenish patterns. It is 
presented because the Design was such that the evidence of Carry-over is 
unequivocal. Each Treatment was tried by each of a n\imber of men. Some 
men started with (l) and some with (2) and then followed a sequence of 
trials. The men were divided into 12 groups eg.ch of about 20 men. The 
men of a given group followed a given sequence of trials. For each Week 
there was calculated the percentage of the time that the men said they 
were satisfied with the Treatment. 

Tine 0th week was set aside, as a conditioning week, i.e., as a week 
in which a participant tried one or the other of the two competitive 
Treatments but he returned no comment (at least one that was used). For 
the next ^ weeks he was given one Treatment to try for each week, and his 
satisfaction was considered. It can be seen that in each case there is an 
(l) preceded by a (2) and one preceded by an (l); similarly there is a (2) 
preceded by a (2) and one preceded by an (l). The symbols (l) and (2) are 
balanced in Weeks. It is, accordingly, interesting to summarize the results 
according to the Treatment given and the Treatment preceding as shown in 
Table Vb. Finally, as in Vc averages are formed. The things that are 
striking about these numbers are that Treatment (l) averages less than 
Treatment (2) but secondly that both Treatments average higher after (2) 
than after (l). That is to say that the character of the two Treatments is 



evidenced just about as well in the response to other Treatment a week 
later as it is evidenced in the week that the Treatment is tried. The 
carry-over effect is of much the same size and nature as the direct or 
main effect. Our evidence seems to suggest that the use of good Treatment 
improves performance of subsequent Treatment in much the same way as an 
experience with bad Treatment depresses performance of subsequent Treatment. 

It may be noted that the Design of Table Va is perfect for the strict 
detection of both the direct effect of the two Treatments and for their 
Carry-over. As the statistical term is they are not confounded with 
column or week effects. Each Treatment is tried equally each Week and 
each Change-over and presumably Carry-over occurs equally each Week of 
the trial. 

Carry-over may be physical as when an animal is subject to a suc- 
cession of diets and traces of diet in one Period may linger on into the 
next Period. Again it could be physical if medication similarly lingered. 
In this case we should call the Carry-over positive because benevolent 
Treatment tends to give a desirable response in the following Period. Cn 
the other hand it could be psychological. Someone judging the degree of 
satisfaction of a Treatment may be influenced by the satisfaction of some 
previous Treatment. Then it is hard to say whether the Carry-over will be 
positive or negative. If the preceding Treatment was satisfactory then the 
Treatment under immediate consideration may be judged favorably in associa- 
tion in which case we say there is a positive Carry-over. Here good 
Treatment tends to elicit favorable response at the next Period. Cn the 
other hand, if the preceding Treatment was satisfactory then that under 
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Table V - Two Treatments each tried by 12 Groups of Men 



a. Deslp:n and Results 



GrouD 


0 




1 


weeK 

2 




3 




4 
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I 


~njTT 


(1) 


72.3 


cry 


56.9 


(2) 


59 . h 


(2) 


70.0 


258.6 


II 


((D) 


(2) 


76.0 


(2) 


75.0 


(I) 


72.8 


(1) 


77.5 


301.3 


III 


((2)) 


(1) 


61.7 


(D 


51.7 


(2) 


61.7 


(2) 


64.2 


239.3 


IV 


((!)) 


(2) 


75.6 


(2) 


75.6 


(1) 


71.1 


(1) 


70.2 


292.5 


V 


((2)) 


(1) 


36.4 


(1) 


38.2 


(2) 


52.7 


(2) 


57.8 


185.1 


VI 


((D) 


(2) 


61.8 


(2) 


49.1 


(1) 


61.8 


(1) 


70.9 


243.6 


VII 


((2)) 


(1) 


65.5 


(1) 


^^6.4 


(2) 


61.8 


(2) 


81.8 


265.5 


VIII 


( ( 1 ) ) 


(2) 


57.8 


(2) 


70.6 


(1) 


60.0 


(1) 


62.0 


250.4 


IX 


( ( 2 ) ) 


(I) 


60.0 


(1) 


62.7 


(2) 


68.2 


(2) 


69.7 


260.6 


X 


((D) 


(2) 


68.9 


(2) 


67.8 


(1) 


60.0 


(1) 


57.8 


254.5 


XI 


((2)) 


(I) 


63.8 


(1) 


58.3 


(2) 


60.7 


(2) 


67.8 


250.6 


XII 


((D) 


(2) 


6o.4 


(2) 


67.3 


(1) 


67.3 


(1) 


54,4 


249.4 


Sum 






760.2 




729.6 




757.5 


804.1 


3051.4 


Mean 






63.4 




60.8 




63.1 




67,0 


63.6 



b. Sorting results according to Treatment and previous Treatment 
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76.0 
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70.2 


57.8 
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68.9 
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58.3 




52.7 


60.7 






70.9 


5^-.^ 
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60.4 = 765.0 
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57.8 


67.8 






61.8 


67.3 


= 752.7 


49.1 


67.3 = 816.7 


1569.4 


Sum 






1469.7 




1581.7 


3051.4 


c. A.verap:es 


















Treatment 






After 






(2) 




Mean 


Contrib, 


(1) 


57775 “ 




"63.75 




"^>1.75 


~ 1.32 


(2) 


62.72 




68.06 




65.39 


+ 1.82 


Mean 


^1.24 




55.90 




63.57 




Contrib. 


-2.33 




+2.33 
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immediate consideration may be judged harshly in contrast, in which case we 
say there is negative Carry-over. It is indeed hard to tell how matters of 
judgment will go and one can only be guided by the ascertained facts - 

Insofar as the reader is impressed by these facts and by others of 
the same kind produced later, he should be warned of a curious phenomenon. 
The irresistible inclination of people, who are not statistical, is to stairt 
discussing the machinery of such an effect. They want to argue as to what 
must go on in the minds of the participants. That seems an innocent enough 
thing to consider. The next thing, however, they become so involved in one 
another's hypothetical machinei-y that they start disputing about it. They 
proceed tangentially to the question of the machinery of how Carry-over 
might work. There arises much speculation as to what is in the hearts and 
the minds of the participants. They end up by proving to their own satis- 
faction that some machinery does not exist and feel that they have therefore 
dismissed the fact. The fact remains actually. Accordingly, we should not 
discuss the fairly obvious machinery but stick to the facts and their 
implications. Our proper business is to discover, in fact, whether (and 
not why) the response of participants to some type of Treatment is affected 
by previous Treatment . 

Men who pass as practical are inclined to confuse themselves with 
the foregoing type of result or to ignore it entirely. They are inclined 
to try 2 Treatments, one after the other. The first Week they may try 
one Treatment entirely, the second Week the other. By doing this they get 
a situation where the effect of pa,rticular Weeks is confounded together 
with carry-over effects with true treatment effects . They had better almost 

guessed at the quality of their Treatment. At a somewhat more sophisticated 
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level they may have half the men try a given Treatment in one V/eek and the 
other half the men try the other Treatment. Then the second 17eek each man 
vill try the Treatment he was previously denied. There are, however, dangers 
in such a 2-treatment experiment completed in 2 Periods. 'Where Treatment 
effects are significant we see what would tend to have happened if we had 
run 2-treatment studies, of the type where half the Groups get Treatment 

(1) the first Week and Treatment (2) the second Week, while the other half get 

( 2 ) the first Week and (l) the second Week. This is what may be characterized 
as the straightforward, coiranonsense approach to the question. We must ^ 
however, ask ourselves how far such a commonsense program wisely advises and 
how far it misleads. It can be seen that the typical 2-week, 2— treatment 
study tends to underestimate in this case the extent to which the Tres,tments 
differ from the control; it judges Treatment (l) which probably deviates 
considerably from (2) as deviating little. They may judge poor product, 

(1) i.e., (63fo), as in Table V when preceded by good Treatment, (2), to 

be much the same as good Treatment, (2), i.e., (64^), when preceded by 

poor Treatment (l). Would we then do right to say that the two kinds of 
Treatment are the same? 

Given the data of Table V, a well-instructed man would have two serious 
alternatives in reporting or recommending. First, he might say that there had 
been tried out the two Treatments properly to balance out any possible 
carry-over effects so that at least they are equally associated with the 
treatment effects, in the Design above. Then (l) preceded equally by (l) 
and ( 2 ) gives Sl.% satisfaction whereas (2) preceded equally by (l) and (2) 
gives 66^ satisfaction. As an alternative, he might report that a 

Er|c 4 7 



k6 



maxi using one kind of Treatment at all regularly will be more like (2) after 
(2), i.e., 68^, and (l) after (l), i.e., 60 %. 

If there is Carry-over but it is of negative character, i.e., makes a 
man judge particularly ill Treatment in general after he has experienced good 
Treatment, problems of quite another kind would arise. The alternation of 
Treatments (l) and (2) would tend to heighten the contrast between them and 
greatly gratify an experimenter anxious to find statistical significance of 
some kind. He might report that Treatment (l) gave very low satisfaction 
while ( 2 ) gave very high satisfaction. He, in this way, might mislead. If 
the experience of having tried (2) much depressed the satisfaction enjoyed 
with further such then (2) would appear to much less advantage in the long 
run than on the short run of the exx3sriment . 

Change-over and Carry-over in a l i tin square - The realm where the writer and 
it seems other people have done xhe most work and thinking on Change-over 
and where we have the most experience on Carry-over is that of the latin 
square with t , the number of Treatments, even. For cases of t , even, 
there is always possible, as is discussed in Chapter IV, a Design with the 
desirable kind of Change-over, as below. Consider, in illustration, a test 
on 6 Treatments, (l) through (6), for which results, in a measure of satis- 
faction, were as shown in Table Via. The Design is a regular latin square 
(except for the conli.tioning Week marked 0 which is extra) but it has the 
■unusual feature that each Treatment follows all other Treatments so that we 
may form some opinions about the Carry-over. These data may be sorted, along 
the same lines as the data of Table V, according to Treatment and preceding 



Treatment. This has "been done in Table VIb . It vill be seen that, in 
general, if a Treatment has a high average the results folloving that Treat- 
ment are high, i.e., the means for Rows and Columns in VIb go together. In 
such experiments with several Treatments tried, when the Treatments hai'^e 
considerable effect the Carry-over is considerable — it is very often in the 
same direction or so-to-speak positive. It may be noted in this case we 
get again the curious result that poor Treatment following good Treatment does 
as well or better than good Treatment following poor Treatment . So there can 
be a serious danger of misleading by bad experimental design and analysis. 

In Table VIb the original Columns are equally represented in each Treatment 
(vertically) and following each Treatment (horizontally). The original Rows 
remain equally represented in each Treatment but, of course, the original Rows 
are a little confounded with the Carries— over . Thus in row I, the Carry-over 
of Treatment (l) appears twice but the Carry-over of Treatment (4), not at 
all. 

In Table VIb, there is shown against each Carry-over the mean. The de- 
parture of the mean for Treatment or for Cari’^'"- over (After) from the corner 
mean of 56.4 is shown as the appropriate contribution. It is of some interest 
to notice the correspondence bt reen Treatment and carry-over effects. This 
can be assessed by calculating the correlation coefficient* for m.eans or 
for contributions . It is considerable, being +.93. 

Typically in the kind of experiment involved in Table Via, the condi- 
tioning or 0th week woul.d be omitted. Accordingly, the values on the 



In case anyone does not know, the correlation coefficient measures tha 
correspondence of two sets of ijres . It is +1.00 for perfect direct coi' * 

respondence; .00 for no correspondence and -1.00 for perfect contrai’iwise 
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Table VI - Satisfaction reported “by 6 Groups or) 6 Treatments over- 6 W eeks 

a. Data collected 



Week 



Group 


0 


1 2 3 1 ) 5 6 


Sum Mear, 


I 


((D) 


(DU 6 .U ( 3 )U 5.8 ( 2 ) 1 + 0. 8 ( 5 ) 62.4 ( 6 ). 59^9 (U) 6 l.T 


317.0 52,-8 


II 


(( 2 )) 


(2)60.9 ( 4 ) 59-2 (3)44.9 ( 6 ) 64.2 (i)' 55..3 ( 5 ) 52.0 


336.5 56.1 


III 


(( 3 )) 


(3)50.0 (5)50.0 ( 4 ) 64.2 (1)60.9 (2)58.4 (6)53.3 


336.8 56.1 


IV 


Uh )) 


(4)63-7 (6)72.0 (5)71.7 (2)57.3 ( 3 ). 53. 3 •('1)52.7 


370.7 61.8 


V 


(( 5 )) 


( 5 ) 48.8 ( 1 ) 50.4 (6)56.4 (3)58.9 ( 4 ) 65-6 ( 2 ) 64.2 


344.3 57.4 


VI. 


(( 6 )) 


(6)63.2 (2)58.7 (1)51.8 ( 4 ) 49.6 (5)49.6 (3)53.6 


326.5 5^-1+ 


Sum 




333.0 336.1 329-. 8 353.3 342.1 337.5 


2031 . 8 


Mean 




55.5 56.0 55.0 58.9 57.0 56.2 


.56.4 



b. Data arranged by Treatment and by Treatment of the preceding Week 



Treatment 



After 


( 1 ) 


( 2 ) 


( 3 ) 


( 4 ) 


( 5 ) 


( 6 ) 


! S''jm 


Mean 


Contrib. 


(1) 


46.4 


58.4 


, 45.8 


49.6 


52.0 


56. 4I 308.6 


51.4 


- 5.0 


(2) 


51.8 


60.9 


53.3 


59.2 


62.4 


53.3 


' 3I+O.9 


56.8 : 


:•' + .4 


(3) 


52.7 


40.8 


50.0 


65.6 


50.0 


64.2 1 


^ 323.3 


53.9 


; -2.5 


( 4 ) 


60.9 


64.2 


44.9 


63.7 


49.6 


72.0 


355.3 


59.2 


'+2.8 


(5) 


50.4 


57.3 


53.6 


64.2 


48.8 


59.9 


334.2 


55.7 


! - -T 


(6) 


55.3 


58.7 


58.9 


61.7 


71.7 


63.2 


369.5 


61.6 1 


! +5.2 


Sum 


^317.5 


340.3 


306.5 


364.0 


334.5 


369.0 


2031.8 






Mean | 


1 52.9 


56.7 


51.1 


60.7 


55.8 


61.5 




56.4 




Contrlb,| 


1 - 3.5 


+ .3 


-5.3 


+4.3 


-.6 


+5.1 


i 

1 









h9 

principal diagonal of Table VIb would be omitted, i.e., the results for a 
given Treatment would not include a case where the Treatment would be preceded 
by itself, i.e., the treatment total would not embrace its own Carry-over. 

The mean for that Treatment would be necessarily biased by the imbalance of 
the Carr ies-over . The corresponding estimate of Carry-over would be 
necessarily biased in the direction of the balance of the Treatments . The 
Carry-over, in brief, as will be discussed in detail in later discussion on 
Carry-over, would, to some extent, be confounded wibh direct treatment effects 
as well as previously discussed, to some extent with row effects. This 
confounding is, however, small in degree in a latin square, as compared with 
other Designs. The direct treatment effects would be confounded to some 
extent with Cariy-over but with nought else. 

many cases the Carry-over of a Treatment varies as much, or 
almost as much, as the direct effect of the Treatments rt might in some sense 
be used to discover the Treatment effect. Perhaps even more pointfully the 
direct Treatment effect and Carry-over might be used conjointly to discover 
the effect of Treatment. Such procedure would be very efficient but it is 
perhaps a shade questionable lander the practical conditions. It has not 
been developed. 

The occurrence of Carry-over in routine latin squares, particularly of 

the type 4xi+x4 for t even and a kind of double Design two (3x3x3) for 
t odd, as will be discussed later, has been thoroughly examined by the writer 

-a numerous tests using men. The conclusions reached have been that the pat- 
tern of Treatment of participants should be such that one test Treatment has 
much the same background as another. In practice, the Designs, termed 



o 

ERIC 



50 



"balanced Carry-over, should "be regularly employed. This should "be done 
because there is often clearly a Carry-ovr- r of Treatment responses from 
the Treatment used prior to a given test Treatment. Insofar as the pre- 
ceding point is sound, experiments consisting of several (such as 6 
kinds of Treatment) are s^lperior to those consisting of 2 kinds of 
Treatment. . The experiment on 2 Treatments or Materials in 2 Periods , 
to which the iinlnstructed mind will be foTJnd to turn freely may be bad 
because possible Carry-over can.be balanced only with a certain difficulty 
as in Table "V. In experiments with t > 2 one does not oven need the 
conditioning Period as shown at the beginning in Table "71 ; this matter wll 
be gone into later in detailed discussion of the analysis of experimental 
data. The conditioning 0th Week of Table VI is simply Included because 
for the moment it simplifies the argument as to the existence of Carry- 
over. In practice Designs with t=2 should be used as little as possible 
The idea of confoimdlng of effects will occur frequently throughout 
the following discussion and so should perhaps be considered now. It 
occurs in Table VI in the sense that the Carry-ov^r of Treatraent (l) 
appears twice in Group I and not at all In Group IV. Wow if for some 
reason these Groups are inclined to give higher readings than the other 
Groupo, the Carry-over of Treatment (l) will appear favorable. There is 
nothing but good luck to distinguish such possible Group effects from 
effects of Carry-over. They are confounded. ... 

Carry-over in Youden Designs (c < t) - In Youden Designs, other than the 
latln squares, where the number of Columns is less than the number o-f 
Treatments, (c < t). It is difficult to discover the general nature of 
Carry-over in so simple a way as from a latin square. There the 
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Confounding of Carry-over with Rows is trivial, so th.-,t the Carry-over 
stands out, as in Table VIb , pretty plain. When, however, . c < t as 
in Table II (c = 4 ,t = T) 9 even the calculation of direct Treatment 
effects in the Youden is not immediately obvious. Certain Treatments and 
certain Changes-over occur in some Rows but not in others and if those 
happen to be Rows with, high values the Treatments or Changes-over, involved, 
appear high at first glance. When c < t , it is difficult, or impc ble , 

i 

to demonstrate Carry-over in any i-ough but at all convincing way. It does 
occur and can be demonstrated by more involved analysis, as will be done 
in Chapter VI. With Youdens , c < t , it is possible, but generally im- 
practicable, to use a conditioning Period such as that shown for the 
latin square of Table VI. 

In case. Carry-dyer effects do occur in Youdens, c < t , they can be 
controlled to a large extent; we may at least reassure ourselves that no 
Treatment is repeatedly preceded by some other Treatment so that the direct 
effect of the first is confounded with the Carry-over of the second. In a 
Design such as that of Table Ila, 7x.4xT 9 plainly we cannot have 
Treatment (2) preceded by every other Treatment because (2) occurs but four 
times. The most we can ask is that (2) or any other given Treatment, shall 
not be preceded by a given other Treatment more than once. This was 
achieved in the Design presented although the matter was not pointed out at 
the time. There are two rewards fo:- this arrangement. First, if we neglect 
Carry-over, any possible tendency to obscure main Treatment effects will be 
minimized. Secondly, if we choose we can set up the necessary equations to 
solve for Carry-over — they will be considerable although, of course, far from 
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the almost impossible level that they would attain if we just randomly 
assigned Treatments to Groups. If we suppose that in the first column, 
there was common background Carry-over, the pattern of direct Treatment 
and Carry-over is as follows : 



Treatment 




are regular and also in conjunction with each other are regular. Thus 
is the isolation of the effects simplified and strengthened. All the Youden 
squares used in the present book are constructed when possible on this 
principle of no repetition of Carry-over. It has been necessary to rewrite 
the Designs given by the textbooks to achieve this. By so doing, not only 
is the effect of Carry-over minimized but a good basis has been laid to 
estimate It by algebraic operation, if that be required. 

The desirability, or one might even say necessity, of controlling 
Carry-over in experimental design, bears on the question of balanced incom- 
plete blocks, as discussed in Chapter I, in connection with Table II. In 
the little example given the^ e of a balanced incomplete block gotten by 
r^mdom permutation within the Bows of a 7x4x7 Youden, we find, if we 
ignore the first Column, which has perhapo some common background Carry-over, 
the pattern of direct Treatment and Carry-over as follows : 





TreatT'.ient 




It can be seen that the Carry-over is irregular. Thus it is plain that the 
disposition of Treatments in Columns may be of some importance even in 
balanced incomplete blocks. This , necessity bears on design of the type dis- 
cussed in this book, vhere one must constantly vonder whether it is necessary 
to control the occurrence of Treatments according to Column, i .e ., 'whether 
Youden Designs are really necessary or whether balanced incomplete blocks 
might not suffice. Such a question is inevitable if effect of Columns seems, 
as it often does, triA'ial. The difficulty remains, however, that when the 
procedure is by change-over. Carry-over will be confounded with Treatment. 

The problem we are faced with is that even if Columns are not important in 
themselves, the Change-over may amount to the same thing. So the balanced 
incomplete block canncb actually be employed freely and one might as well 
use Youden Design anyhow. Then in the analysis the effect of Columns can be 
ignored but Carry-over can still be considered. 

Carry-over in paired comparisons - In paired comparisons, i.e., Changes-over 
involving 2 Treatments per unit, carry-over effects may occur just as in any 
of the Designs discussed just previously. Carry-over may be simply allowed 
for by controlling the Treatments that a given Treatment follows or it may 
be estimated. An example of unrepeated Change-over is given in Table I 
where it can be seen that no given Treatment is preceded twice by any other 

Treatment. Shortly after that table there is given an example of testing 
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4 Treatments where the Design has not only \mrepeated Chav'ge-over hut 
balanced Change-over. A given Treatment is preceded by all other Treatments. 
It may oe noted that if it is req^uired to have a given Treatment preceded by 
all other Treatments it is necessary to write 20^ Rows for t , odd, the 
same as for t , even. A conditioning Period may be used or simply a 

preceding period of common background. The former is illustrated later in 
Table XXXVIII althorigh it is hard to work such things out. The latter (com- 
mon backgroimd) is the more prs-ctical. 

Contiguity problems - The previous discussion of Change-over where one designs 
in 1-space of a Row and time progresses to the ri^ht is closely related to 
the even more general and not uncommon problem of contiguity of Treatments, in 
2-space. This is somewhat outside the purpose of the present discussion but 
may be touched on briefly Ivore. Thus even in the classic field of Agronomy 
a Treatment may effect the response to another contiguous to it. Agronomy 
is no proper part of our business,: so we must leave this discussion as a 
suggestion. One must wonder, however, whether in the classical agronomic 
experiments contiguity may not have some bearing, whether it has not been 
neglected and whether it should not be controlled. The writer has dis- 
cussed with Dr. W. J. louden his work in this realm but there seems -to be 
no' extensive literat'ure on the subject. 

The type of Design, discussed in the present work, that assures that no 
Treatment is ever preceded twice by any otlier given Treatment automatically 
assures us also that no given Trea w follows it twice. Hence no Treatment 
has any other Tre&tnent beside it -unduly. For work as in Agronomy, howeve'i-, 
it wo-ul,d be necesso.r;v’ consider neighbors in a second dimension. By way of 
a suggestion, an appropr'iaco Design, with unrepeated Change-over in Rows and 
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from Row to Row, can be written in the case of spacial latin squares. The 
matter is discussed at more length in Chapter IV, in connection with the 
topic of latin squares, t even. Here we may simply give the example of 

a 6-treatment experiment, like that 'shown in Table VI, but with somewhat 



1 .e . 3 

(1) 


(3) 


(2) 


(5) 


(6) 


(U) 


(3) 


(5) 


ih) 


(1) 


(2) 


(6) 


(2) 


ih) 


(3) 


(6) 


(1) 


(5) 


(5) 


(1) 


(6) 


(3) 


ih) 


(2) 


(6) 


(2) 


(1) 


(M 


(5) 


(3) 


(U) 


(6) 


(5) 


(2) 


(3) 


(1) 



This is gotten, of course, by simply rearranging the Rows of Table VI. 

Here, of course, contiguity in both Rows an.d Columns is well taken care of. 
Any Treatment like (l) has any other Treatment (2) 'through (5) contiguous 
in either a Row or Column U times . It may be of concern that 20/36 of 
the plots are edge plots. If so there might be put buffer plots, judiciously 
treated but not counted, about the Design as above. Perhaps we might 
designate buffer plots by double parenthesization and write: 





((1)) 


((3)) 


((2)) 


((5)) 


((6)) 


iih)) 


((U)) 


((1)) 


(1) 


(3) 


(2) 


(5) 


(6) 


ih) 


((3)) 


(3) 


(5) 


ih) 


(1) 


(2) 


(6) 


((6:) 


((2)) 


(2) 


ih) 


(3) 


(6) 


(1) 


(5) 


((5)) 


((5)) 


(5) 


(1) 


(6) 


(3) 


ih) 


(2) 


((2)) 


((6)) 


(6) 


(2) 


(1) 


ih) 


(5) 


(3) 


((3)) 


((U)) 


ih) 


(6) 


(5) 


(2) 


(3) 


(1) 


((1)) 


iih)) 


((6)) 


((5)) 


((2)) 


((3)) 


((1)) 





How any Treatment like (l) has every Treatment, including itself, contiguous 
in either a Row or a Column times . 

T;to positions, with regard to analysis, might be taken with such data, 
just as they may be taken in handling change-over experiments. The more simple 
position is to comfort caaeself that insofar as contiguity is of importance, no 
Treatment will be heavii.y confounded by the nature of its neighbors. The 
^ difficult position is to eliminate, if necessary, the effect of contiguity 
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from the estimates of effect of I'reatmant and a3.ways eliminate it from the 
estimates of residual variability. Such analysis could be easily enough 
completed along lines indicated in the later chapters. Contiguity ^ pre- 
sumably, would work not only in t'jo dimensions but so-to~speak, backwards 
and forwards , 
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IV. Writing Youden Designs 

The general prohlem of vrlting Youden designs 

Latin squares, t even 

Paired latln squares, 2(txtxt), t odd . . . . 

Yates rectajagles, tx(t - l)xt 

Single Youdens where c - (t + l)/2 

Single Youdens where f-1 

Intractable single Youdens . . . . 

Paired Youdens for balanoe of Change-over 

Double Youdens where c=(t+l)/2 

Double Youdens , non-central 

Single Change-over ....... 



Page 

58 

65 

T3 

T5 



T9 



80 

8k 

89 

92 

96 

9T 
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The general problem of wltlng Yonden designs - It should be real that 

■while Table 11 shows what Youden rectangles, txcxr, where r = t or = 2t , 
can exist, it does not necessarily prove they do exist. In fact the liter- 
ature knows of two, as discussed later, that do not exist and a third such 
case has been disoovered, as In connection with Table XIV, in the course 
of the present work. For some no Design of any kind has ever been submitted, 
as was discussed in Chapter II, on exploration of the Youden field, and even 
in this book no Desrgn is submitted. Even granting the existence of a 
Design in a general way for any particular case it may not exist subject to 
the restriction that no given Treatnient is ever preceded (or for that matter 
followed) by any other Treatment more than once. 

It seems good practice to "write Designs, indicated as possible in 
Table II, subject to the restriction that the Treatments in a Column are 
arranged in cyclic order. This matter was illustrated in the Designs of 
7x3x7 and ’Jxk-x'J which were previously presented and discussed at some length. 
To repeat the Design for the latter: 



CoLumn 



Row 


1 


2 


3 




1 


(1) 


(2) 


(^) 


(7) 


II 


(2) 


(3) 


(5) 


(1) 


III 


(3) 


(^) 


(6) 


(2) 


IV 


(^) 


(5) 


(7) 


(5) 


V 


(5) 


(6) 


(1) 




VI 


(6) 


(7) 


(2) 


(5) 


VII 


(7) 


(1) 


(3) 


(6) 



The advantages of such Design, when It is possible, are many, 
place one may examine the forward differences in Row I, i.e., 



In the first 
1, 2 and 3. 
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These containing no repetition, it follows that Treatment (l) can never be 
followed twice by any other Treatment. Prom the relationship existing 
between any two Rows, it follows that if Treatment (1) is never followed 
twice by any other Treatment that the same kind of statement can be made 
for (2), (3). ••(7). There are many theoretical advantages such as the fact 
that the sequeriGe of forward differences 1, 2 and 3 proves immediately that 
the Design is Youden but on these let ua not dwell. Rather let us consider 
the enormous practical advaritage of being able to hand such suriple Design 
to the unsophisticated man who must apply it in the fury of the clinic. To 
its aimplicity he can comply- -let the reader examine some of the noncyclic 
examples that follcw and imagine himself applying them in either fury or 
heat. Further let us remember the ease with which we can' discover a misap- 
plication of a Design in the present simple form; it can be done at a rapid 
glance; it requires no elaborate proofing. The writer suspects that one of 
the reasons that adequate experimeiital design has found as little applica- 
tion as it seems to have found, is that it often seems too complex to 
administer In practical situations. 

Cyclic form is not only easy to proof and easy to manipulate but it is 
easy to abbreviate. For Instance, we may abbreviate the case of 7x^x7, Just 
shown to 

7x4x7 f = 2 _ 

How l (1) (2) (4) rr) 

12 3 

When it is understood that the Columns are, of course, written in cyclic 
order, modulo t . First forward differences, which may be useful, have 
been added to the statement of Treatments in first Row. The fill, which 
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may be useful, has ‘been noted against each Design. The other example, 

previously employed, can be 'written much more cunningly and economically as 

Tx3x7 f ^ 1 

Row I (l) (2) (U) 

A 12 

This form saves a great deal of space. The forward differences, added, 
reagstire us that the Change-over is indeed unrepeated. They are also some 
reassurance against copying errors. Double Youdens can be written In similar 
abbreviated form. Thus we can write 5x2x10, f - 1 , at length as: 





Coluirm 
1 2 


Row I 


(1) (2) 


II 


(2) (3) 


III 


(2) ik) 


IV 


ik) (5) 


V 


(5) (1) 


VI 


^^:i) (U) 


VII 


(2) (5) 


VIII 


(3) (1) 


IX 


ih) (2) 


X 


(5) (3) 


' In abbreviated form we may write 


5x2x10 f = 1 


Row I 


(1) (2) 


A 


1 


VI 


(1) 


A 


3 


few multiple Youdens, g > 2 when 


be written in the abbreviated formj 




tx&cl2 f = 2 


Row i 




A 


1 


V 


ni ur 


A 


s 


DC 




A 


3 
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The Designs, Just shown for ?x3xT and 7x4x7 are cases where no Change- 



over is repeated but they are not balanced in the sense that every Treat- 
ment is preceded by every other Treatment. There are simply not enough 
Columns. They are cases of the type that was recoimiienaed in Chap. Ill as 
the best possible for distinguishing Carry-over from direct treatment effect. 
In Designs with unrepeat ad Change-over at least no Treatment is ever preceded 
(or for that matter followed) more than once by any other Treatment. The 
Designs with halanced Change-over have every Treatment preceded once and 
once only by all other Treatments, Let us turn at once to an example of 
the latter, l.e., the double Youden, 9x5x18, f — 5 , as in Table Vll. It 
can be seen there where every Treatment following (6) is, for the sake of 
illustration, underlined, that (6) is followed by everything (except of 
coxirse, (6)). It is Inevitable that no single Youden c < t can he 
balanced. There are t - 2 or fetrer Changes-over so no Treatment can be 
followed by all t - 1 other Treatments , Designs with balanced Change- 
over seem very desirable. If one is working roughly one may comfort 
oneself by ignoring any possible Carry-over saying that it will have little 
or no effect on the Judgment of treatment effects. If one Is working more 
exactly it is comparatively easy to eliminate arithmetically^ or to estimate 
arithmeticali^, the magnitude of such. Carry-over. This matter is discussed 
later in the section on analysis of results. Looking at the matter in 
another way, unrepeated Change-over gives the maximum chance of separating 
Carry-over from direct treatment effects. 

For latin sq^uares , it is possible to balance Change-over in an 
especial way by having them preceded by a conditioning Period (or 
Column), as in Table VI, Such a conditioning Period is possible for single 
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Table VII. A double Youden 9x5x18. illustrating balanced Chaage-oyeg ^, 



ColuBm 



Row 


1 


2 


3 


4 


-5 


I 


— 


(2) 


(4) 


(7) 


(3) 


II 


(2) 


(3) 


(5) 


(8) 


(4) 


III 


(3) 


(4) 


(6) 


(£) 


(5) 


IV 


(4) 


(5) 


(7) 


(1) 


(6) 


V 


(5) 


(6) 


(I) 


(2) 


(7) 


VI 


(6) 


(7) 


(9) 


(3) 


(8) 


VII 


(7) 


(8) 


(1) 


(4) 


(9) 


VIII 


(8) 


(9) 


(2) 


(5) 


(1) 


IX 


(9) 




3) 


M 


(2) 


X 


ar 


(9) 


(6) 


U) 


(8) 


XI 


(2) 


(1) 


(7) 


(5) 


(9) 


XII 


(3) 


(2) 


(8) 


(6) 


(1) 


XIII 


(4) 


(3) 


(9) 


(7) 


(2) 


xtv 


(5) 


(4) 


(1) 


(8) 


(3) 


XV 


(6) 




(2) 


(9) 


(4) 


XVI 


(7) 


(6) 


(2) 


(1) 


(5) 


XVII 


(8) 


(7) 


(4) 


W 


(6) 


XVIII 


(9) 


(8) 


(5) 


(3) 


(7) 
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or multiple Youdons, but. is unprofitable since balance of this especial 
character remains unachieved. 

The following sections list various single Youden Designs^ t x c x t , 
c < t , for purposes of listing subdivided Into kinds essentially elassified 
according to the ease of their ■writing but also bearing some correspondence 
to their utility. The range of Designs covered in these tables is_, arbitrarily^ 
2 ^ t ^ 36 and 2 ^ c ^ 18 , Over this raiige Designs are shown %^herever 
possible. There are commonly many more Designs for a given t x c x r 
situation than the one shown in the following tables. In some cases It is 
impossible, ■with exhaustive seac’ch, to find a Design, 'and this Is reported. 
Finally, -there are some Designs ■which are still ^.mformied for lack of time. 

The Designs sho-wri in the following tables -were found to some extent 
in the literature — essentially from Cochran and Cox (195?) -who give an 
extensive table of actual Designs of single loudens of the type to which 
we have restricted ourselves. They make little distinction bet-vreen cyclic 
and non-cyclic Designs although some are of each type. Also, some of their 
non— cycj.ic Designs can easily be put in cyclic order. An extensive table 
of balanced Incomplete blocks is given by Fisher and Yates (1957). Such 
is the correspondence bet-ween these and Youdens that some Youdens can be 
extracted. They point out that some Designs can be -written In cyclic form. 

They do not allude to the utility of this feature; Cox ( 1958 ) stresses the 
usefulness of cyclic Designs. None of these sources was anywise concerned 
about Change-over or any other form of aontigulty. One finds in the lltera- 
ture^ Indeed, many Designs where a given Treatment is preceded in all cases 
by some other one Treatment, so that a given Carry-over must be completely 
confounded with some given Treatment effect. All the Designs that could be 
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adopted required rearrangement^ particularly -with regard to unrepeated 
Change -over . It was necessary indeed to work out most of the rollcrtsTing 
Designs. They were found principally by various devices which will not 
be discassed here* because they would surely not forward the business of 
this hook which is to facilitate the application of such Designs, 

It should perhaps be mentioned^ in a cautionary way^ that the experi- 
mental Designs to be indicated shortly, and a ll through the present book 
are not to be subjected to any randomization-. This has to be mentioned 
because randomization is so cornmonly recoinmended that some innocent may 
take it for granted. Randomization, beyond perhaps the ordering of the 
experimental units (Men, Machines or whatever ) would be of no use in the 
Designs proposed. As was discussed in Chapter III, randomization within 
the Rows of the present Designs will turn them into balanced incomplete 
blocks which will probably be appropriate if one is doing agronomic work 
but will be highly inappropriate for change-over experiments. Some people 
may be uneasy at the set and systematic nature of our Designs, They may 
be concerned that successive experiments may, in some way, be correlated. 
Such uneasiness may be allayed by their assigning Treatment numbers randomly. 

The Youden Designs c < t recommended themselves to us, as at the 
beginning of this book, because we could get work done quickly. By employing 
many participants one could form opinions on t Treatments in less than 
t Periods. There is, of course, a limit to such economy because, from 
Equ. (4), If f > 1 , 



*Beall, G. Sc J. J. Ferris, On discovering Youden rectangles with 
Columns of Treatnaents In cyclic order. Research Bulletin 71-3T. K*inceton, 
J. : Educational Testing Service, 1971. 

ERIC 
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c > 



ror single Youdens- Similar ly*^ for doulle Youdens 



c > 




(6) 



It 



hould tie noted that in the present change-over Youden reetangles 



and latin scLuares^ as in such Designs more generally 5 each Treatment 



occurs oncsj and once only^ in each Period. Thus are the effects of 
Treatment freed froin any systematic additive effect of Periods. In the 
literature, particularly of Animal Husbandry, one may find much concern 
as to vhether such effects of Treatment are systematic. Thus it may be 
asked vhat is the pattern of lactation of a cow with time. Such enquiry 
may be very important but is in the present book avoided | here the 
concentration is on the restricted question of what does Treatment do. 

The larger question of investigating the entire system requires a famil- 
larlty with more general statistical theory. 

Latin squares, t even It is desirable to have latin squares t x t x t , 
t even, with the usual property of each Treatment once and once only in 
each Row and in each Colunm. For present piorposes they should additionally 
have Treatments in Columns in cyclic order (mod. t ). They should also 
have unrepeated Change-over, i.e,, no Treatment to be preceded by any other 
Treatment more than once. For a latin squELre the last condition actually 
means automatically balanced Change— over, i.e., each Treatment to be 
preceded by all other Treatments. To Indicate the nature of a Design it 
is, of course, sufficient, as discussed previously, to write the first 
Rcw# For that matter. In order to set up the Design, it is sufficient to 
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investigate the first Row. Thus if one wants to write a latin scjuare of 
the present type for 4 Treatments, i.e., 4 x^,a 4 with fill, f = 4 , a suit 
able Design is 



Column 



Row 


1 


2 


3 


4 


I 


(1) 


(2) 


(^) 


(3) 


II 


(2) 


(3) 


(1) 


(^•) 


III 


(3) 


(4) 


(2) 


( 1 ) 


IV 




(1) 


(3) 


(2) 



It is, however, sufficient to wT-ite 

4x4x4 f = 4 

id (D PD [jT 

A 1 2 3 

Bradley (1958) has provided a method for designing latin squares with 
unrepeated Change-over, for t even. His specifications for filling the 
I’lrst Row are as follows. Assign successively the integers from 1 to t 
to the t cells in the first Row by proceeding from left to right entering 

only cells in odd-numbered Columns, then reversing direction fill 
cells in even-niimbered Columns. Then complete the Columns in cyclic 
order, modulo t . Thus for 8x8x8 one gets the Design, 

Row I (1) (8) (2) (7) (3) (6) (4) (5) 

A 7254361 

As he observes, while the Period Immediately preceding Treatment t can 
be occupied but once by any other Treatment, the one before that is occupied 
by only two Treatments, Specifically, for Treatment (k) these are 
Treatments (k - l) and (k + l) . This is f^omewhat undesirable if there 
is any tendency towards 2-period Carry-over. 
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6 ? 



It f'^ems ■worth.'wiill.e to ■wi'ite Designs free, as far as possible, from 
this shortcoming in the period preceding, but one, a given Treatment. 

Such designs for latln squares, are sho-wn in Table VIII. Every Treati- 
ment Is followed once and once only by every other Treatment. This is 
accomplisaed by ■writing the Treatments in the first Row so that no forward 
difference is repeated. Designs of this kind have been found for all cases 
of t 5 even, that have been at all extensively examined. There is only one 
solution for t — 2 , two solutions for t = U , while there are four solutions 
for t = 6 and Increasingly large numbers of solutions as t increases. 

In Table VIII, there is shown only one Design foi' each value of t . It 
was chosen so that Periods previous to that Immediately antecedent contained 
as little as possible the same Treatments. In the Designs given for 6x6x6, 
10 x 10 x 10 , 12 x 12 x 12 , I6xl6xl6 and l8xl8xl8 no Treatment is repeated two 
Periods previous, nor for that matter, three or four or whatever previous. 

It will be noted that the numbers 6, 10 , etc., are all one less than a 
prime number. The quality of the Designs seems to he related to the matter 
discussed in connection with Table DC. For 8x8x8, there exists, by exhaus- 
tive examination, no Design where the Treatment two weeks previous is 
■i;y^0p0ated, so that the Design of Table VIII is the best that can he done. 

It is improbable that there is such a settlement for ltxl 4 xlh so that 
given in Table VIII is as good as possible. These solutions are not diffi- 
cult to find* even as t becomes great, so that Table VIII could be much 
extended If anyone wanted larger latin squares of this type. 

*Beall, G. On writing latln squares with unrepeated Change-over. 
Educational Testing Service, Princeton, N. J . . (in , procpss 19 Tl). 
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Table VIII - Designs i'or la~cln sq.uareSj t even, with Columns cyclic 



2 x2x2 f s 2 ^ 
Row I (l)‘ (2“) 

A 1 



4x^xl4- f = U 

‘I ■(i)‘T2y “(uy T3) 
A 1.23 



6x6x6 f = 6 



I dr(‘3) (2) (5) (6) (4) 
A 2 5 3 1 4 



8x8x8 f - 8 

Row I (1) (2) (4) (7) (3) (8) (6) (5) 
A 1234567 



10x10x10 f ~ 10 

I (iT (2) (9) (3) (5) (10T(8) (4) (7) (6) 
A 1742 58639 



12 x 12 x 12 f — 12 

Row I ( 1 ) (2) (5) (3) (10) ( 6 ) (12) (4) (9) (11) ( 8 ) (7) 
A 13 10 78 645 29 11 



14x14x7.4 f = l4 

ROW I (1) (4) (5) (5) (9) (d) (^) (15) (7) ( 2 ) ( 12 ) ( 10 ) (ll) ( 8 j 

A 5 15 2 4 56 7 8 9 10 12 1 11 



I 6 xl 6 xl 6 f = 16 

ROW iTin2)T4r(7r(inTi6) (6) ( 15 ) ( 5 ) (i4) (8) ( 3 ) ( 15 ) (w tioT(^ 

A 125 4 5-6 78 9 10 11 12 15 i 4 15 

I8xl8xl8 f = 18 ; 

Row I (1) (2} (14) Onil) (15) (7) (4) (9) (18) (15)' (16) ( 6 ) ( 8 ) (12) (5) (iTrCioJ 
A 1 12 7 14 16 10 15 5 9 15 3 8 2 4 11 6 17 



Sow I ( 1 ) (S) ( 16 ) ( 45 ) ( 29 ) ( 5 ) (lit) ( 2 M ( 3 ) ( 15 ) (28) (lo) ( 25 )'FJ 

A 1 a 5 I4- 5 6 78 9 10 11 la 13 15 16 



contin. 

contin. 



Row I (26J (12) (31) (19) (6) (30) (21) (13) (6) (32) ( 27 ) (23) (20) 
A 17 18 19 20 21 22 23 24 25 26 27 28 ^ 




30 31 



*For the Design of 2x&2^ no satisfactory anaT^sls can be made with 
estimation of both direct treatment effeots and Carry-over. The matter is 
discussed at length in Chap. V. 
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The latin squares where t is a power of 2 are particularly easy to 
write in cyclic column form. Thus we have for 4x4x4 the Design as in 
Table VIII and one other solution. For t = 8 , l.e.^ 8x8x8 the solution 
as shown and other solutions. For I6xl6xl6 one can write ^ as can be seen, 
a Design with forrrard differences of 1, 2, p, etc. through I 5 . For 32x52x32 
one can again write this kind of Design, where the forward differences stand 
in arithmetic series. All this is convenient, in at least a small way, 
because Designs involving the powers of 2 are very popular in some circles 
and one may accordingly easily be called upon to evaluate 2^ kinds of 
treatments. For Designs of this kind there sometimes appears a given Treat- 
ment twice at the period two weeks previous to another given Treatment but 
this may be somewhat better thra, the proposal of Bradley (1958), as previously. 
For squares with t + 1 prime there is a second type of Design where 
the Columns are not in cyclic order but which is worthy of mention nonethe- 
less. It is illustrated in Table IX, It involves constant forward differ- 
ences in a given Row, modulo t + 1 , where t is the order of the square 
and different forward differences In each Row, Thus for 4x4x4, the forward 
differences in the first Row are 1, in the second Row 2 etc. The Designs of 
the type in Table IX do have the advantage that they can be very rapidly 
fo\md, whereas those of Table VIII require a little searching. So if one 
wanted to go beyond the latter, it is fairly obvious how Designs might be 
written for t = 22, 28, 30 etc. In the Designs of Table IX no Treatment 
is repeated two Periods previous to, a given Treatment, nor for that matter, 
three or four or whatever previous, A s imi lar result is obtained by Allmena 
(1962), again for t + 1 prime, but by what seem more Involved and difficult 
methods. He refers to the Designs as "perfectly counterbalanced latin squares. 



O 
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Table DC - Typical Designs for latin squares, t 4- 1 prime 

4x4x4 f = ^ 

ColunUT, 



Rov/ 


1 


2 


3 


4 


I 


(1) 


(2) 


(3) 


(4) 


II 


(2) 


(4) 


(1) 


(3) 


III 


(3) 


(1) 


(4) 


(2) 


IV 


(4) 


(3) 


(2) 


(1) 



6x6x6 f - 6 



Coltiinn 



RcV! 


1 


2 


3 


4 


5 




I 


“TiT 


(2) 


(3) 


( 4 ) 




(g) 


II 


(2) 


(4) 


(0) 


(1) 


( 3 ) 


(5) 


III 


(3) 


(6) 


(2) 


(5) 


( 1 ) 


( 4 ) 


IV 


(4) 


(1) 


(e) 


(2) 


(6) 


(s) 


V 


(5) 


(3) 


(1) 


■ (6) 


(4) 


(2) 


VI 


(6) 


(5) 


(4) 


(3) 


(2) 


(1) 



10x10x10 f = 10 



Cnlumn 



Hovt? 


1 


2 


3 


4 


5 


I 


(1) 


(2) 


(3) 


( 4 ) 


'(6) 


IX 


(2) 


(4) 


(6) 


(8) 


(10) 


III 


(3) 


(3) 


(9) 


(1) 


(4) 


IV 


(4) 


(3) 


(1) 


(5). 


(9) 


V 


(fi) 


(10) 


( 4 ) 


(9) 


(3) 


v'l 


■ (g) 


(1) 


(7) 


(2) 


(8) 


VII 


; (7) 


(3) 


(10) 


(s) 


(2) 


.■III 


; f '■ 1 

[ s ' ' J 


( 5 ) 


(2) 


(10) 


(7) 


IX 


(9) 


(7) 


(G) 


(3) 


(1) 


X 


(10) 


(9) 


(P) 


(7) 


(s) 



6 


7 


a 


9 


10 


(s) 


(7) 


( 0 ) 


(9) 


( 10 ) 


(1) 


(3) 


(6) 


(7) 


(0; 


(7) 


(10) 


(2) 


(3) 


(Q) 


(2) 


(6) 


(10) 


(3) 


(7) 


(B) 


(2) 


(7) 


(1) 


(e) 


(3) 


(9) 


(4) 


(10) 


(5) 


(9) 


(6) 


(1) 


(8) 


(4) 


(4) 


(1) 


(9) 


(6) 


(3) 


(10) 


(8) 


(6) 


(4) 


(2) 


(S) 


(4) 


(3) 


(2) 


f 1 
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It will, of course, be realized that the Deslgnr of Table IX are quite 
difficult to assign to the unsophisticated person, previously invoked, who 
may have to apply them in the clinic. He will probably botch somewhere and 
we shall be lucly if we notice that. If possible, give him a cyclic Design, 
The difference in type from Table VIII of Table DC is, however, not 
substantial, because the Designs of that table may be transmuted into cyclic - 
column form. Thus in the case of the hx4x4, if one call Treatment (4), 
Treatment (5) and vice versa and similar 1^' interchange the names of rows 
III and IV, it becomes the 

Row I (1) (2) (4) (3) 

A 12 3 

of Table X* By the interchanges 

. (2) ^ (3) (5) - (6) 

(3) (2) (6) ^ (1) 

(4) ^ (5) 

and appropriate Row renaming the 6x6x6 of Table IX becomes 

Bowl (1) (3) (2) (5) (6) (4) 

A 2 5 3 1 4 

The IftclOxlO is very easily so transmuted. Obviously, these cases with 
t + 1 prime when the background of previous Treatments is totally unrepeated 
will give rise by such tra n smutation into cyclic Designs with the same 
quality. Such Designs were mentioned In connection with Table VIII. 

The Designs of Table DC have contiguity balanced in 2-space. This has 
heen previously .Indicated in Chap. II, which introduced the matter of Carry- 
over. On the other hand, those of Table VIII have contiguity confounded 
with Treatment in 2-space, It is, however, also possible to control 



O 
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2~dlmenslonal contiguity in the Designs from Table Vlll^ by rearranging 
Rows. One is governed by the order in which the Treatments appear in the 
first Row and must rearrange the Rows so that the Treatments in the first 
Column appear in the same order. Thus given the 6x6x6, one might write 

Row A 2 5 3 1 

7^^ (1) (3) (2) (5) (6) ik) 

II 2 (3) (5) (i^) (l) (2) (6) 

III 5 (2) (4) (3) (6) U) (5) 

IV 3 (5) (2) (6) (3) (4) (2) 

V 1 (6) (3) (1) (4) (5) (3) 

VI 4 ( 4 ) ( 1 ) ( 5 ) ( 2 ) ( 3 ) ( 1 ) 

Such working from Table VIII makes Designs for t + 1 , not prime, possible, 
whereas Table IX suffers from that limitation. 

In setting up latln squares it is always theoretically possible, 
generally desirable but conmonly impolitiG for t > 2 to precede the 
general Design by a conditioning Column (or period). ' This is conceived as 
a Period when various Treatments are administered or Materials are tried, 
according tc appropriate plan, in order to introduce as convenlent3^ as 
possible the Carry-over effects that may be In the experiment. The analysis 
will be discussed later. From the point of view of designing the natter is 
very slmple--the program that could otherwise be the first Column is admin- 
istered beforehand. In the Illustrative Designs below, the indication is 
the double -bracketed Treatments are for conditioning, i.e,, for the sake of 
subsequent Carry-over, No experimental results would be recorded for these 
Periods. Thus for the two kinds of 6x6x6 Designs one might alternatively, 
write ; 
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Coluian 



Row 


d 


1 


2 


3 


4^ 


5 


6 


i 


((D) 


(1) 


( 2 ) 


(6) 


( 3 ) 


( 5 ) 


(4 


II 


(( 2 )) 


(2) 


(3) 


(D 


(4) 


(6) 


(5 


III 


((3)) 


(3) 


( 4 ) 


(2) 


(5) 


(1) 


(6 


IV 


((4)) 


(4) 


(5) 


(3) 


(6) 


(2) 


(1 


V 


((5)) 


(5) 


(6) 


(4) 


(D 


(3) 


(2 


VI 


((6)) 


(6) 


(1) 


(5) 


(2) 


(4) 


(3 



or 



Coltuon 



Row 


J 


1 


2 


3 


4 




6 


I 


nrir 


(1) 


(a) 


(3) 


(4) 


(5) 


(6) 


II 


(( 2 )) 


(2) 


(4) 


(6) 


(1) 


(3) 


(5) 


III 


((3)) 


(3) 


(6) 


(2) 


(5) 


(D 


(4) 


IV 


(U)) 


(4) 


(1) 


(5) 


(2) 


(6) 


(3) 


V 


((5)) 


(5) 


(3) 


(D 


(6) 


(4) 


(2) 


VI ] 


((6)) 


(6) 


( 5 ) 


(4) 


(3) 


(2) 


(1) 


it in E 


iquares, 2(txtxt) 




odd - 


Designs 


1 for 


pair( 



squares^ 2(txtx‘b)^ are shoro In Table %• It is necessary to 'write these 
later squares in this form because it is impossible to use the more aijiple 
form of txtxtj mth Columns cyclic and no repetition of Change-over, as 
when t was even. In the case of 5x5x5^ for Instance, it is, of course, 
easy enough to write a latin square with cyclic Coltunns and all latln squares 
are Youden. It is, however, impossible to avoid repetition of Change-over, 
so that in the sense of the present discussion, it is impossible to write a 
Youden Design. If one thinks of writing Designs in the fonn of Table VIII, 
i.e., of the first Row of treatment numbers and the forward differences of 
those treatment number s, then it is Impossible to write the Treatments from 
(l) ttoough (t) in any order such that at least one forwar'd diffei’ence will 
not be repeated. The theory of the matter has been discussed by Houston 
(1966), It is possible, however, to write 2 such latin squares where the 
forward difference repeated in one is omitted in the other and vice versa . 
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and balanced Change-over, 

_i, . iiiiMii . - - ^ rni-^ I 



2 (3x3x3 > 

Row I 0) (2) (3" 
A 11 

IV (1) (3) <2) 
A 2 2 



'2 (5x5x5) f^lQ 
I (1) (2) (4) (3) (5) 
A 1 2^ 4 2 

VI (1) (5) (3) (4) (2) 
A 4 3 13 



‘ 2 (7x7x7) f«l4 

I CD (2) (4) (7) (6) (3) (5) 

^A 1 2 3 6 4 2 

VUI(l) (7) (3) (2) (3) (6) (4) 

,A 6 5 4 1 3 5 



2 (9x9x9) f^l8 

Row I (D (2) (5) (9) (7) (4) (3) (8) <6)" 

.4 1 3 4 7 6 8 5 7 

X (D (9) (6) (2) (4) (7) ‘(8) (h (5) 

A 86523142 

2(11x11x11) ^ • f^22 

I CD (9) (3) (10) (1) C4) (8) (7) (5) (6) (11) 
A 8 5 7 3 2 4 10 9 1 5 

xn CD (4) (10) (3) (11) CD (5) (6) (8) (7) (2) 
^ 3 6.4 89712 10 6 



2(13x13x13) • fs26 

Row 1 (1) (2) (4) (7) (11) (6) (1^) (6) (13) (10) (9) (3) (5) 

A 123 48 69 S 10 12 72 

XIV (1) (13) (11) (8) (4) (9) (3) (7) (2) (5) (6) (12) (10) 
A ■ 12 11 10 9 5 7 4 8 3 1 6 11 



^ 2(15x15x15) f-30 

Row 1 (1) (2) (4) (7.) (11) (6) (12) (8) (15) (9) (14) (13) (10) (3) (5) 

4 1 2 3 4 10 6 11 7 9 5 14 12 8 2 

XVI CD <15) (13) (10) (6) (11) (5) (9) (2) (8) (3) (4) (7) (14) <12) 

4 14 13 12 U 5 9 4 8 6 10 1 3 7 13 

12(17x17x17) f^34 

Row 1 CD (2) (4) (7) (11) (16) (D~a4) (8) (17) (Ys) (12) (9) (15) (10) (3) (5) 

4 1 2 3 4 5 7 8 11 9 13 16 14 6 12 10 2 

XVIIT (D (17) (15) (12) (8) (3) (13) (5) (11) (2) (6) (7) (10) (4) (9) (ISY (14) 

4 16 15 14 13 12 10 9 6 8 4 1 3 11 5 7 15 



2(19x19x19) ___ f»3S 

Row I ■(l)(2)(4)(7)(irr(l6)(6')(lS)(19)(16}( 9) (17)(l4) (l3) ( 8)(18)(10)( 3)rS) ‘ 
A 1 _ E 3 4 5 9 6 7 15 13 8 16 18 1 4 10 11 12 2 

l^nJKl^i7)(14)(lO)n)(15)( 9)( 2)(6)(12)( 4) (tHS) (13) (3) (11) (18) (16) 
A 18 17 16 15 14 10 13 12 4 6 11 3 1 6 9 8 7 17 
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Accordingly, one gets a total Design where every Change-over occurs twice, 

A list of such Designs is shown in Table X, The claims made for these 
Designs are illustrated in Table XI for the case of 2(5x5x5)j f = 10 , 

It Is hardly necessary to draw up the comparlEon table because obviously 
any such Treatment as (ij is comparsd once with every other Treatinent 
in each Row and there are 10 such Rowe, The question of what Treatments 
follow what may be of some interest and so che matter is tabled. 

For the paired latln squares, as previously for the single latin squares, 
t even, it is probable that one might Introduce a preliminary conditioning 
Period or Column for the sake of Carry-over. 

Yates reetangles, tx(t-l)xt - Designs for Yates rectangles 
tx(t-l)xt 3 t even or odd, are shown in Table XII, It is possible 
always to write Yates rectangles with Treatments in cyclic order in 
Columns and with unrepeated Change-over. Their presentation in Table XII 
is similar to that of the latln squares in Table VIII, i.e., the Treatments 
of the 1st Row and their forward differences are shown. 

As has been previously pointed out in connection with the Design of 
Youdens, generally speaking when t<36, c<t-l,is even one gets 
few single Youden arrangements and no double, whereas for t odd, and of 
the same magnitude, c < t - 1 , there are many single and double Youdens, 

In the related field of balanced Carry-over latln squares c = t , the situa- 
tion is in a sense opposite j the squares with t even can be written with 
Change-over well-balanced but the squares with t odd cannot be written with 
satisfactory Change-over | we have to use the device of paired latln squares, 
as discussed previously. The happiest class of designs are the Yates 
rectangles, c = t - 1 , which can always be written Just as we want them. 
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Table XI 



The character of paired latln squares Illustrated In the case of 

2 (5x5x5), f=10 



a. Design, as from Table X, in full 



Ooliimn 





O 
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Ta~ble XTT . Designs for Yates rectangle^. 



3x2x3 f=l* 



RO’W I (l) (2) 
A 1 



Ax3xl^ 

1 (iT (3) ( 4 ) 

A 2 1 



5x4x5 f-3 



6 x 5 x 6 f=4 



I (1) (5) (3) (4) 
A 4 3 1 



I (iT (3) (2) (y) 
A 2 5 3 



7x6x7 



f«5 



Fo^I (T) (i) (4) (7) (6) (3) 
“ 1 2 3 6 4 



8x7x8 



£=6 



9x8x9 



f^7 



1 Cl) (2) (^) (7) <3) C3> W 

■ A 1 23456 



1 (l) W (5) <f) (7) <4) (31 (8) 
A 1 3 4 7 6 6 5 



.__A 0 x 9 x 10 -vr,?V r^W 4 ) (7) (lY(Z) m 

feow 1 (1) <2) ( 9 ) ( 3 ) ( 5 ) ,(i0) \3) ( ) (7; A ' 1 3 5 7 9 10 6 2 

A I 7 I 1 C 15 363 



7 



4 



12x11x12 



f^ll 



Row id) ( 2 ) ( 5 ) ( 3 ) Tio) ( 6 ) (12) ( 4 ) (9) (H) W 
A 13 10 7 S 645 29 



13x12x13 — 

r5w i (l)(t.)<4)(7) a i) (« (12) (») (12) (») (’) (2) 

1 2 3 4 8 6 9 5 10 12 / 



14x13x14 



f-l 2 



Row I (T) (4) (i) (S) (9) (14> ( 6 ) 
^ . 3 13 2 4 5 6 



0 > (?) (12) (10) (11) 

t 8 9 10 12 1 



Row 1 (1) O) (U) (7) ^11) Ci) (12) (8) ^15) (9) (14) (13) (10)W 

4 1 2 3 4 10 6 11 7 9 5 14 12 8 



16x13x16 



■f*14 



ROW I (1) (2) (4) (7) (11) (16) 

A. 1 2 3 4 5 6 



^13) (5) (14) (8) (3) (15) (12) (10) 
7 8 9 10 11 12 13 14 



O 

ERIC 
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i6x15x16 



f=l 4 



Row I (1) ( 7 ) ( 14 ) ( 13 ) (2) (1+) (16) ( 3 ) (11) (8‘) (12) (10) (5) (6TI15T 
A 6 T 15 5 2 12 3 8 13 4 14 11 1 9 



17x16x17 f=l5 

(t) ('2-) w (7) (i i) (i^) <6) (I#) m (i/KU) (ia> (^) (15) rS) (3) 



A 



5 7 8 11, 9 13 16 14 6 12 10 



18x17x18 



16 



RowTll) ( 2 )U 4 ) ( 3 ) (IT) ( 15 ) (7) ( 4 ) ( 9 ) (18) ( 13 ) (16) (6) (8) (12) ( 5 ) (H 
A 1 12 7 l 4 16 10 15 5 9 13 382 4 11 6 



I9xi8xl9 



f-lT_ 



I 

A 



(1) (2) ( 4 ) (T) ( 11 ) (16) (6) 
1 2 3 4 5 9 



(12) ( 19 ) ( 15 ) ( 9 ) (IT) ( 14 ) ( 13 ) W) (18) (10) ( 3 ) 
6 T 15 13 8 16 18 l 4 10 11 12 



*The Design, 3 x 2 x 3 cannot be used to estiinate Carry-over, It is advisable 
to use the paired Design 

Row I ( 1 ) ( 2 ) 

A 1 

IV ( 1 ) ( 3 ) 

^ 2 

See Table XXXII for example . 

**The Design, 4 x 3 x 4 ; will yield estlinates of direct Treatment and Carry- 
over but provide no test of significance without repetition , 
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They are of particular importance in the case of t oddj for which the 
paired latin squares are necessary^ if latin squares one would have in 
the present connection. Considerable difficulty arises^ as in connection 
with Table X with this. Most of the advantages of the latin square can be 
obtained from a Yates rectangle with less difficulty in design and applica- 
tion. In a sense ilie Yates rectangle may play the role of the intin square 
when t is odd and might profitably be used far more frequently than seems 

the case. 

From the comparison of Tables VIII and XII^ plainly for t , even, the 
Yates is gotten by dropping the last Column of a latin square and this approach 
may be usefully extended to Designs of the type shown in Table IX. Thus 
if you should want the Youden, 22x21x22, one could follow the general line 
of the latter table and then drop the last Column - 



Youdens wher e cg(t»l)/2 - Aft. extremely useful class of single Youdens 
is that where the number c of Col'^fflns is about half the nuniber of the Treat- 



ments. TtilB may, perhaps, be thought of as cenl^al Youdens in the sense that 
c is about half-way between its minimum of 2 and the critical point of t , 
l.e., the latin squsire. It takes febout half the tajne, i.e., nuniier of Columns 
that is required for a latin square or Yates rectangle. Oliese Designs, 
shown in Table XIII have unrepeated Change-over and Trea-teients in cyclic 



order in the Columns • In these Designs , obviously, t 4m - 1 , m being 
the suceeaslve integers starting with unity. 'Hie 5x2x5 already shown in 
Table XII Is, of course, omitted. For all members of the series t < 51 , 
Designs were found except for 27x13x27 (and eomplementary SjKlkxZj ) for which, 
by exhaustive exploration, none ^clst. In the case of prune numbers, t — 

4m - 1 (m > 0 an integer) it Is jp'retty plain, fran the cases where t = 45 
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and t = 47 , how things probably go if one should want to go beyond the list 
shown in Table XIII. 

For these Youden rectangles, and for those in the iimnediately following 
section, it is impossible to control 2-space contiguity In the way possihle 
for latin squares, t even, as previously discussed. This is Imposslhle, 
because tht it was necessary to rearrange Bows so that the downward 
differences were never repeated and that Is impossible when t is necessarily 
odd. This impossibility is the same as that of arranging latin squares, 
with t odd, so that forward differences are never repeated. 

Single Youdens where f = 1 - There has been found one other class of single 
Youdens that may be written in cyclic Columns with unrepeated Change-over, 
to wit, those where f = 1 , i.e. , 

c ^ (1 + At - 3)/2 . 

They are extremely useful because the c is necessarily quite small, of 
magnitude , and so If Columns are time the work can be done very quickly. 

The Designs 3x2x3 and 7x3x7 belong to the present series 
but have been presented In earlier tables. The 3 Designs 13x4x13 etc,, 
found, are presented in Table 3CIV. Together with each Design, where t x c x t 

gives f ■= 1 , there exists a COTiplementary with tx(t-c)xt. It may be 
foimd readily enough but is generally not of much use because t - c is too 
close to t . The Design, 43x7x45, would be expected in Table XIV but it 
cannot* be wr'ittan in any way, cyclic or non-cyalic. The next highest member 

*Beall, G. A bal an ced incomplete block which might be expected but does 
not exist and other members of its respectable family. Educational 
Testing Service, H'inceton, N, J, (in process , 1971)* 



O 
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Table XIII- Deeifius v.’haro ce( t±. l)/2 

7k3m 7 f-1 * 7 k4k 7 f-2 

1.(0 (a) (4) I (ly (2) (4) (7) 

^ 12 -A 1,23 



IIkSxII 

AoH) I (T) (i) (4^‘ (7T (1,1) 
^ 12 3 4 



11x6x11 2 ., 

Row I (1)(2)<4)(7)'(T1) (1) 

A 1 2 3 4 5 




1 5 xPk 15 £= 4 19x9x19 1^4 

1 (1) (7) (12) (6) (15) (3) (5) (6) ' Row I (1) (2) ( 4 ) (7) (11) (16) (3) (10) (18) 

^ 65 11 732 1 ^ 12345678 



9x10x1 f ^5 

(1) (2) (4) ("7) (11) (16) (3) (10) (IS) (8) 
A 123 4 56 7,89 



23x51x25 _ j=g _ _ 

Row I ( 1 ) (t) ( 4 ) T 7 )"(U) (/ 6 ) ( 24 ) ( 6 ) ( 14 ) ( 23 ) (iO) 

A 123 4 5 67 8 9 10 

23x1&£25 

JiT In (4rT^‘ 1 ATTii) (ajrao) (if) 

A 1 , 2 i 4 5 6 7 8 9 lU 11 



31x15x31 y 7 

ROW 1 (I.) ( 3 -) ( 7 r(ll) ( 16 ) (^) (ii?) (A) (if) C 2 ^) ^ (I'T) ( 3 ^ 

-O . L 2 3 4 5 6 7 S 9 10 i.1 12 13 14 



Wf 



Row 1 a) (t) (t) (7) (ti) (/#) (iZ) 

A 12 3 4 5.6 70 



(5) (I'j) (:?©)■ ( ») M 
10 11. IX 13 i4 15 



ERIC 



45x21x43 fslO 

Row I (l)(2}(4){7}(Il)(l6)(EE)(29)(37)(3)(13)(24)(36)(”iy(20)(S6)( 8) (26) (43) (19) (39) 



12 3 4 



Row I 

4 



7 8 9 10 11 IE 13 14 15 16 17 18 19 20 

4_3x2Ex4S f,ix 



12 3 4 



6 ) ( 20) (3 : ) ( 8) (26) (43 ) ( 19 ) ( 3 9 ) ( 17 
7 8 9 10 11 12 13 14 l\ 16 17 18 19 20 21 
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Carry-over but provide no test of significance without repetitii 
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Table XIV - Single Youdens where fill, f = 1 



13x4x13 

Row I (1) (i) (6) (8) 

A 4 1 2 



ROW I (1) (2) (5) (7) 
A 13 2 



21x5x21 

Row I '(i; (4) (5) (10} (12) 
A 3152 



3^^6x31 

Row I "(1) ( 2 ; (5) (11) (13) (18) 
A 13 6 2 5 



Row I (1) (2) (4) (9) (13) ( 19 ) 

A ' 1 2 5 4 6 



low I “(1) (2) (5) (7) (l4) (22) 
A 13278 



Row I (i; (8) (11] c5mi9) ( 51 ) ( 32 ) ( 36 ) 
A 7562 12 14 



75x9i^3 

Row 1 (1) (3) (11) ( 25 ) (26) (3'0) (37) (43) (46) 

A .2 8 l4 1 4 7 6 3 



9:oaOx91 

Row 1 ~(l) (2) ( 7 ) ( 11 ) (24) C^) (35) (42) (54) ( 56 ) 
A 1 3 4 13 3 8 7 12 2 



• 133x12x133 

Row I ( 1 ) ( 26 ) (30) (39) (49) ( 56 ) ( 67 ) (83) (88) ( 89 ) (91) (103) 
A 23 4 9 10 7 11 16 5 1 2 12 




Sit 



of the series, 111x11x111, has not been found in extensive, but not exhaustive, 
exploration; there is some reason to suppose that no Design exists. The 
series might be profitably extended to deal with problems usually of prelimin- 
ary character, where a very great many Treatments must be explored. 

With regard to the writing of complementary Designs the practice may be 
briefly stated. Given a Design t x c x t , then complete each of the t 
Rows by the t - c Treatoents that it lacks. In this way there will be pro- 
duced the balanced incomplete block pattern for t - c Treatments, Rearrange 
these by permutations within Rows so that each Treatment occurs once and once 
only within each Column, The condition that a given Treatment be preceded not 
more than once by any other given Treatment may be added. 

Intractable single Youdens - Many of the possible single Youdens shown or 
suggested by Table IV remain unTO-ltten with the Treatments cyclic in the 
Colimns, let alone written with unrepeated Change-over. They are a mis- 
cellaneous assembly where c^^t, c^t-l, c^(t± l)/2 and 
f 7 ^ 1 . There are situations where a single Youden, such as l6x6xl6, 
f - 2 5 may exist, but cannot be written In cyclic form. This particular 
Design can, however, be written Innon-cyclic form with unrepeated Change- 
over, as below in Table XV. 

In the series of single Youdens with t - 2 ^ 4x3x4, 7x4x 7 and 

11x5x11 belong, of course, to earlier series and for each of them a Youden 
Design with cyclic Coluims and unrepeated Change-over has been shown, Jor 
the next member of the class, otherwise, l.e., I6x6xl6, there is no cyclic 
arrangeraenti this by exhaustive exploration. For this fairly common and very 
useful situation, there has been found a Youden, as shown in Table XV, with 
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Table XV ” Won-cvellc Youdens vlth unrepeate^ Change-over, l.e.. I6x6xl6. 



Deslpn 



Column 



Row 


1 


2 


3 


k 


5 


6 


1 


(8) 


(9) 


(1) 


(13) 


(6) 


(?) 


II 


(5) 


(10) 


(2) 


(14) 


(?) 


(8) 


III 


(6) 


(11) 


(3) 


(15) 


(8) 


(5) 


IV 


(?) 


(12) 


ik) 


( 16 ) 


(5) 


(6) 


V 


ih) 


(13) 


(5) 


(9) 


(2) 


(3) 


VI 


(1) 


ilk) 


(6) 


(10) 


(3) 


(4) 


VII 


(2) 


(15) 


(?) 


(11) 


(4) 


(1) 


VIII 


(3) 


( 16 ) 


(8) 


(12) 


(1) 


(2) 


IX 


( 16 ) 


(1) 


(9) 


i^) 


(14) 


(15). 


X 


(13) 


(2) 


(10) 


^. 6 ) 


(15) 


( 16 ) 


XI 


ilk) 


(3) 


(11) 


a) 


( 16 ) 


(13) 


XII 


(15) 


ik) 


(12) 


;8) 


(13) 


(14) 


XIII 


(12) 


(5) 


(13) 


(1) 


(10) 


(11) 


XIV 


(9) 


(6) 


ilk) 


(2) 


(11) 


(12) 


XV 


(10) 


(?) 


(15) 


(3) 


(12) 


(9) 


XVI 


(11) 


(8) 


( 16 ) 


(4) 


(9) 


(10) 



b» Change-over 

Followed by 



Treatment 


(1) 


(a) 


(3) 


(4) 


(5) 


(6) 


(?) 


(8) 


( 9 ) ( 10 ) (11 ) ( 12 ) ( 13 ) ( l4 ) ( 15 ) (16 ) 


(1) 




X 














X 


X 






X 


X 




(2) 






X 














X 


X 






X 


X 


(3) 








X 














X 


X 






X X 


(4) 


X 
















X 






X 


X " 




X 


(5) 












X 






X 


X 






X 


X 




(6) 














X 






X 


X 






X 


X 


(?) 
















X 






X 


X 






X X 


(8) 










X 








X 






X 


X 




X 


(9) 


X 


X 






X 


X 








X 












(10) 




X 


X 






X 


X 








X 










(11) 






X 


X 






X 


X 








X 








(12) 


X 






X 


X 






X 


X 














(13) 


X 


X 






. X 


X 
















X 




(14) 




X 


X 






X 


' X’ 
















X 


(15) 






X 


X 






X 


X 














X 


( 16 ) 


X 






X 


X 






X 










X 







O 
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non-cyelic Colurans but -wltli \mrepeated Change-over. This Design is Youden 
in that it double-fills the comparison table. It does have unrepeated 
Change-over as may be seen in XVb. This is the type of Design shown by 
Fisher and Yates (I 967 )> except that, of course, they have no concern with 
Carry-over. For the next two potential members of the series, 22x7x22 and 
29x8x29, there exist no Designs, as are prevlous’l^ the case for 45x7x45^ 
f = 1 , according to Hussain (1945 and 1946), . Curiously enough, there is 
for the next meraber a cyclic arrangemnt, 

37x9x37 f = 2 

Row I (1) (2) (4) (8) (18) (25) (30) (36) (26) 

A 124. 10 7 5 6 27 

In the series of single Youdens with f = 3 , 3x3x3, 5x4x5, 11x6x11 and 
15x7x15 belong, of course, to earlier series and for each of them a Youden 
Design with cyclic Columns and unrepeated Change-over has been shown. For 
the case of 25x9x25, there Is by exhaustive examination, no such arrangement. 
Also probably for 31x10x51, f = 3 , there is no such arrangement. For the 
moment, a Design for 25x9x25, f = 3 , taken from Cochran and Cox (1957 ) with, 
hawever, repeated Change-over, and similarly one for 31x10x31, f = 3, from 
the statistical handbook of the Chemloal Rubber Co, , with the same short- 
coming, are shown in Table XVI, Ftobably it is just a matter of the necessary 
effoit to rewrite each with unrepeated Change-over. 

The situation seems Hiuch the s am e for the series where f=4, l,e, , 4x4x4, 
15x8x15, 34x12x34 etc. The first 2 members belong to earlier series and 
have been shown. No eye lie -column Design was found for 34x12x34, f=4, although 
the matter was not explored thoroughly. 
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Talole XVI - Mon-cyellc Youdens with repeated Change-over when f = 3 

a. 25x9x25, f = 3 



Column 



Row 



( 8 ) ( 9 ) 



I 


(1) 


II 


( 18 ) 


III 


(3) 


y 


(4) 




(T) 


VI 


(5) 


VII 


(9) 


VIII 


(6) 


IX 


(25) 


X 


(10) 


XI 


(11) 


XII 


(12) 


XIII 


(13) 


XIV 


(2) 


XV 


(19) 


XVI 


(21) 


XVII 


(20) 


XVIII 


(15) 


XIX 


(14) 


XX 


(IT) 


XXI 


( 16 ) 


2QCII 


(22) 


XXIII 


(23) 


30C1V 


(8) 


3DCV 


(24) 



(2) (3) 

(i) (l4) 

(16) (1) 
(T) (10) 

(h) ( 12 ) 

(9) (19) 

(5) (13) 

(8) (16) 

(15) (6) 

( 12 ) ( 2 ) 

(13) (4) 

(10) (5) 

( 11 ) ( 8 ) 

(20) (23) 

(24) (22) 

(3) (18) 

(19) (11) 

(22) (T) 
(IT) (24) 

(14) (9) 

( 18 ) ( 21 ) 

(6) (20) 

(21) (25) 

(25) (IT) 

(23) (15) 



) (5) 

(22) (15) 

(2) (IT) 

( 1 ) ( 21 ) 

(13) (1) 

(25) (18) 

(20) (23) 
( 11 ) ( 22 ) 

(14) (12) 

(9) (24) 

(23) (25) 

(8) (l4) 

(5) (20) 
(T) (10) 

( 21 ) ( 2 ) 

(10) (4) 

(3) (8) 
( 16 ) (13) 

( 12 ) ( 11 ) 

(6) (19) 

(15) (3) 

(24) ( 16 ) 
(IT) (6) 

( 18 ) (T) 

(19) (9) 



(6) 


(T) 


(23) 


(19) 


(24) 


(21) 


(20) 


(11) 


(l6) 


(it) 


(1) 


(24) 


(21) 


(1) 


(IT) 


(10) 


(13) 


(8) 


(15) 


(22) 


(9) 


(14) 


(2) 


(16) 


( 18 ) 


(2) 


(25) 


( 18 ) 


(11) 


(13) 


(8) 


(23) 


(4) 


(12) 


(5) 


(25) 


(3) 


(5) 


(10) 


(3) 


(12) 


(6) 


(l4) 


(4) 


(19) 


(15) 


(22) 


(9) 


(T) 


(20) 



(3) (2) 

( 25 ) (20) 

(14) (15) 
( 18 ) ( 19 ) 

( 11 ) ( 10 ) 

( 12 ) ( 22 ) 

(1) (23) 

(24) (1) 

(IT) (4) 

(2) ( 16 ) 
( 19 ) ( 21 ) 

(15) (IT) 

(6) (12) 

(T) (6) 

(13) (24) 

( 22 ) ( 25 ) 

(10) (3) 

(23) (7) 

(20) (13) 

(9) (11) 

(5) ( 18 ) 

(4) (5) 

(21) (i4) 

( 16 ) (8) 



Note that Change-over is repeated; this matter has not heen adjiisted. 
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•b. 31x10x31, f ^ 3 



Column 



Bow 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


1 


(1) 


(2) 


(4) 


(8) 


(9) 


(11) 


(15) 


( 16 ) 


( 18 ) 


(28) 


11 


(2) 


(3) 


(12) 


(9) 


(10) 


(17) 


( 16 ) 


(19) 


(5) 


(22) 


III 


(3) 


(4) 


(20) 


(10) 


(17) 


(13) 


(6) 


( 18 ) 


(11) 


(23) 


IV 


ih) 


(5) 


(7) 


(11) 


(12) 


(21) 


( 18 ) 


(14) 


(19) 


(24) 


V 


(5) 


(6) 


(1) 


(12) 


(13) 


(8) 


(19) 


(20) 


(15) 


(25) 


VI 


(6) 


(7) 


(13) 


( 16 ) 


(l4) 


(9) 


(20) 


(21) 


(2) 


(26) 


VII 


(T) 


(1) 


(15) 


(14) 


(8) 


(10) 


(21) 


(17) 


(3) 


(27) 


VIII 


(8) 


(11) 


(17) 


(25) 


( 16 ) 


(23) 


(29) 


(7) 


( 26 ) 


(5) 


IX 


(9) 


(12) 


(24) 


(29) 


(27) 


( 18 ) 


(1) 


( 26 ) 


(17) 


(6) 


X 


(10) 


(13) 


( 18 ) 


(19) 


(29) 


(25) 


(2) 


(27) 


( 28 ) 


(7) 


XI 


(11) 


(14) 


(22) 


( 26 ) 


(19) 


(20) 


(3) 


(28) 


(29) 


(1) 


XII 


(12) 


(8) 


(27) 


(23) 


(20) 


(29) 


(4) 


(22) 


(21) 


(2) 


XIII 


(13) 


(9) 


(29) 


( 28 ) 


(21) 


(15) 


(5) 


(23) 


(24) 


(3) 


XIV 


(lU) 


(lO) 


(25) 


(22) 


(15) 


( 16 ) 


(24) 


(29) 


(6) 


(4) 


XV 


(15) 


(24) 


( 26 ) 


(5) 


(2) 


(27) 


(11) 


(10) 


(30) 


(20) 


XVI 


( 16 ) 


(25) 


(6) 


(30) 


(3) 


(28) 


(12) 


(11) 


(27) 


(21) 


XVII 


(17) 


( 26 ) 


(28) 


(7) 


(30) 


(22) 


(13) 


(12) 


(4) 


(15) 


XVIII 


( 18 ) 


(27) 


(23) 


(1) 


(5) 


(30) 


(14) 


(13) 


(22) 


(l6) 


XIX 


(19) 


(28) 


(30) 


(2) 


(6) 


(14) 


(8) 


(24) 


(23) 


(17) 


XX 


(20) 


(22) 


(8) 


(3) 


(7) 


(24) 


(9) 


(30) 


(25) 


(:8) 


30CI 


(21) 


(23) 


(10) 


(4) 


(1) 


(26) 


(30) 


(25) 


(9) 


(19) 


XXII 


(22) 


(21) 


(11) 


(17) 


(24) 


(1) 


(25) 


(a) 


(31) 


(13) 


XXIII 


(23) 


(15) 


(3) 


(18) 


(25) 


(2) 


( 26 ) 


(31) 


(12) 


(14) 


XXIV 


(24) 


( 16 ) 


(19) 


(31) 


( 26 ) 


(3) 


(27) 


(4) 


(13) 


(8) 


3QCV 


(25) 


(17) 


(i4) 


(27) 


(31) 


(4) 


( 28 ) 


(5) 


(20) 


(9) 


30CVI 


( 26 ) 


( 18 ) 


(5) 


(21) 


(28) 


(31) 


(22) 


(6) 


(8) 


(10) 


XXVIl 


(27) 


(19) 


(31) 


(15) 


(22) 


(6) 


(23) 


(9) 


(7) 


(11) 


XXVIII 


(28) 


(20) 


(l6) 


(24) 


(23) 


(7) 


(31) 


(1) 


(10) 


(12) 


XXIX 


(29) 


(30) 


(2) 


(6) 


(4) 


(5) 


(7) 


(3) 


(1) 


(31) 


XXX 


(30) 


(31) 


(9) 


(13) 


(11) 


(12) 


(10) 


(8) 


(14) 


(29) 


3QQCI 


(31) 


(29) 


(21) 


(20) 


( 18 ) 


(19) 


(17) 


(15) 


( 16 ) 


(30) 



Note ‘bhat Change-over is repea'bedj ■bhis matter has not heen adjusted. 
From, Hand.hoo]fi of tahles for prohablllty and. statistics. Chemical 
Rubber Co. , Cleveland., Ohio. 
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Paired. Youdens for 'balanoe of Change-over - Table XVII shows paired 
Designs, 2(t x c x t); each single Youden, txcxt, c<t,in its own 
right, but used together to get balanced Change-over. The single Youdens used 
for the combination come at least in a sense, from TableXIII. There ^unrepeated 
Change-over was obtained but there were not enough Columns to balance the 
Chanee-over. Here, however, were c = (t + l)/2 , t being necessarily 
odd, the 2(c — l) Changes-over must exactly embrace the gamut posaihle. 

These Designs of the type 2(t x c x t) resemble somewhat the double’ 

Youdens which follow and where balance may also occur. An example of the two 
Youdens arises from 7x4x7 • Prom this there may be written a Design of 
2(7 x4s 7’) which, has, of course, 6 Changes-o'ver and these may be balanced. 

The Design Isi 



I 


(D 


(2) 


(4) 


(7) 


Row VII 1 


CD 


C5) 


C3) 


C2) 


II 


( 2 ) 


(3) 


(6) 


(D 


IX 


C2) 


C6) 


C4) 


C3) 


III 

IV 


(s) 

(4) 


(4) 

(5) 


(6) 

(7) 


(2) 

(3) 


X 

XI 


(3) 

C4) 


C7) 

CD 


C5) 

Ce) 


C4) 

C5) 


V 


(6) 


(6) 


(1) 


(4) 


XII 


C5) 


C2) 


(7) 


C6) 


VI 


(6) 


(7) 


(2) 


(5) 


XIII 


C6) 


C3) 


CD 


C?) 


VII 


(7) 


(1) 


(3) 


(6) 


XIV 


(7) 


C4) 


C2) 


CD 



Here Ireatraent CD is preceded once and followed bnoe by each cttier Trea'^ent 

( 2 ) ■through (7)« other Trea’teients (2) through ( 7 ) are similarly proGeded 

and followed* If ■this Design is -written in brief form^ 

. 2C7x4k 7) f=4 

Row I (1) <2) <4) (7) 
k 12 3 

VIII (1) (5) (3) (2) 

4 4 5 6 

it can be seen that since Change-over constantly changes, (l) can never be 
followed, or preceded, by ai^ other Trea'taaent twice. This design fills a 
paired-comparison table 4 times. Rows I through VII are a Youden rectangle 
with unrepeated Change-over j Rows VXII through XXV are likewise. 

O 
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Table XVII - Desifgns for paired Yo ude ns, 2 (txoKt )_ v/ ith oyol l o Oolixims 



and balance d Ghv^m^e-over 

! 



• 2 (7x4x7) f^-4 

Row I (1) (2) (4) (7) 

A 12 3_ 

Vlil (1) (5) (3) (2) 
& 4 3 6 



, ■ 2(11k6xU) f^6 

1 (1) (2) (4V (7) (11) (5) 
4 12 3-4 5 

Xll (i) (7) (3) (11) (9) (8) 
A 6 7 8 9 10 



2 (1 5x8x 15) 4 

ili)‘(7Hi4) (B)(r5) (dhsTc^ 

M 6 5 1 1 7_ 3 2 1 

XVI (1) ao) (5) (VHi) (14) (tz) 
9 10 4 S 12 13 



* 2(19x10x19) f--10 

ROW I '(1) (2) (4) (7) (11) (16) (3) (10) (18) (6) • 

A 1 2 3 4 5 ^ 7 S 9 

XX (1) (11) (3) (15) (9) (4) (19) (16) (14) (13) 
A 10 11 12 13 14 15 16 17 18 



^ : 2(23x12x23) f=12 * 

Row I (1) (2) (4) (7) (Tl) (16)' (22) (6) (14) l23) 

4 1 i__J^_,4 5 6 7 8 9 10 ir 

XXIV (1) (13) (3) (17) W (2) (19) (14) (10) (7) (5) (4) 

^ 12 13 14 15 16 17 18 19 20 21 22 



2_ .'i. 2(31x16x31) f^l 6 

Row I (1) (2) (4) (7) (11) (io) (22) (29) (6) (15) (25) (5) (17) (30) (13) (28) 
— A 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 

XXXII (1) (17) (3) (21) (9) (29) (19) (10) (2) (26) (20) (15) (J 1) (S) (SV 

^ 16 17 18 19 20 21 Zt. U 24 25 26 27 20 29 30 
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The foregoing Judicious eomhlnatlon of ‘two single Youdens raises tempta- 
tions that should be firmly resisted. By the combination of varlotis numbers 
of single Youdens much could be achieved, in connection with any given Youden 
where the Change-over is unbalanced but unrepeated it is, naturally, possible 
to combine several in an appropriate way to achieve balance. The only problem 
is that of having enough experimental units. Consider thus the simple Yates, 
kx3xk, in 5 forms, as follows: 



Row I 


( 1 ) ( 2 ) ( 4 ) 


Row V 


(1) (3) (4) 


Row IX 


(1) (4) 


(3) 


A 


1 2 


A . 


2 1 




3 


3 



After 


Treatment 
[ (1) (2) (3) 


(4) 


After 


(1) 


Treatment 
(2) (3) (4) 


After 


Traatment 

( 1 ) ( 2 ) ( 3 ) (4) 


(1) 


X 


X 




IT) 




X 


X 


“Tir 


3QC 


(2) 




X 


X 


(2) 






X X 


C2) 


XX 


(3) 


X 




X 


(3) 


X 




X 


C3) 


XX 


( 4 ) 


X X 






(4) 


X 


X 




(4) 


XX 



or in total 
After 


(1) 


Treatnyant 
( 2 ) L3) 


(4) 


(1) 




30C 


XX 


XX 


(2) 








we 


(3) 


MC 


XX 




XX 


(4) 


30C 


XX 







This is Just an application of an idea developed at some length by Patterson 
and Lucas (1962) where several variants of a Design may be combined to give 
handsomely balanced Change-aver. Such temptation should, however, be resisted 
because there is suggested a complexity that la in fact quite trivial but which 
may disconcert and alarm men who might otherwise use new techniques. 
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Double Youdens vhere c = (t ± l)/2 - It was proposed in Chap. II to write.- Designs 

called double Youdens, of tjrpe t x c x 2t , or in general cases where 

r = 2t as In the discussion about Eq^u. (3)« We cannot write, for instance, 

a 9x4x9 Youden rectangle because it yields, in the sense of the comparison 

table of Table IXb , or elsewhere, l8c| — lOB coFiparisons within Rows to 

fill the 2 C 2 - 72 positions in the comparison table, i.e,, there would 

be 3/2 fill. Accordingly, we write I 8 Rows or 9x4x18 to get 2l6 comparisons 

to fill 72 positions thrice- f = 3 . For the moment attention is restricted 

to what were previously, in connection with single Youdens, as in Tahle XIII, 

called central cases, I.e,, where c = (t ± l)/2 , Such Designs are shown 

in Table XVlII* Kie particular Design of 9x4-xl8 is illustrated 'with data 

later in Table XXXI and it is again discussed^ in another connection, 

in Table XXXV'. In this table all the Designs have cyclic Columns, or perhaps 

one should say double-i-cyclie . Change-over is, of course, always unrep eat ed 

but in some cases, such as 3x2x6, it happens also to work out halaneed. 

These are cases where 2(c - l) , the number of Changes-over occurring equals 
t — 1 , the highest number possible with repetition. These central double 
Youdens of both kinds are, disappointingly, practically the only double 
Youdens with cyclic Col umn s that exist in the realm of t ^ 36 . 

There are , among these centrai double Youdens , two kinds , as follows . 

Pirgb , those where c “ (t — l}/2 • Then the number of Changes—over must 
be less than the number of Treatments with which we should like to compare, 
say. Treatment (l)-. Adcordlngly, the Change— over will not be balanced 
although we may suppose that it should be unrepeated, which will comaonly 
be possible. An example is Desi©i 9x4x18, f ■ 3 » of Table XVHI, ■where 



O 
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If I 


(1) 


(2) 


C4) 


(8) 


Row X 


(1) 


(6) 


(3) 


'(2) 


11 • 


(2) 


(3) 


(5) 


(9) 


XI 


(2) 


(7) 


(4) 


(3) 


III 


(3) 


(4) 


(6) 


(1) 


XII 


(3) 


(8) 


(5) 


(4) 


IV 


(U) 


(5) 


(7) 


(2) . 


XIII 


(4) 


(9) 


(6) 


(5) 


V , 


(5) 


(6) 


(8) 


(3) 


XIV 


(5) 


(1) 


(7) 


(6) 


VI ■ 


(6) 


(7) 


(9) 


(4) 


XV 


(6) 


(2) 


(8) 


(7) 


VII 


(7) 


(8) 


(1) 


(5) 


XVI 


(7) 


(3) 


(9^ 


(8) 


VIII 


(8) 


(9) 


(2) 


(6) 


XVII 


(8) 


(4) 


(1) 


(9) 


IX 


(9) 


(1) 


(3) 


(7) 


XVIII 


(9) 


(5) 


(2) 


(1) 



Treatment (l) Is followed only t»y (2), (3), (5), (6), (T) and (9). Each 
other Treatment is necessarily followed by only some of the other Treatments 
Within a given half of the Design, the comparisons within Rows Involve 
two Treatments not less than once and not more than twice, but the matter 
is not redressed In the other half. Secondly, there are those central 
double Youdens where the number of Changes-over must be exactly the number 
of Treatments with which we should like to compare, say. Treatment (l). 
Accordingly, the Change-over will be balanced. An example is 9x5x18, 
f - 5 , of Table XVIII, where- 



Row I 


(1) 


m 


(4) 


(7) 


(3) 


Row X 


(1) 


(9) 


(.6) 


(4) 


(8) 


11 


m 


0) 


(5) 


C«) 


(4) 


XI 


m 


(1) 


(7) 


(3) 


(9) 


'ill 


(3) 


(4) 


(6) 


(4) 


(3) 


XII 


(3) 


(3) 


(S) 


(&) 


(D 


IV 


(4) 


(3) 


(7> 


(1) 


(6) 


XIII 


<4) 


(3) 


(9) 


(7) 


(i) 


V 


(5) 


(«) 


(8) 


(2) 


(7) 


XIV 


(5) 


(4) 


CD 


(S) 


(3) 


VI 


ro 


(7) 


m 


(3) 


(8) 


XV 


W 


(5) 


m 


(?) 


(4) 


VII 


(7) 


Ci) 


(i) 


(4) 


m 


JCVI 


(7) 


(6) 


(3) 


(1) 


(4) 


Vlll 


(1) 


Ci) 


a) 


0) 


0) 


XVII 


(«) 


(7) 


(4) 


(U 


0) 


IX 


(f) 


(1) 


m 


(6) 


m 


XVIII 


(?) 


(€> 


(-5.) 


(3) 


(7) 


Treatment I 


[1) i 


,8 followed once 


by each of ('2 


) throu^ 


(9) 


, Each 



Treatment is similarly followed by all alternative Treatments, The comparl- 
sons within Rows involved any two Treatments not less than twice and not 
more than thrice In one half. In both halves each Gomparison occurs five 
tlm® altogether. 
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TabXe XVIII - Designs for double Youden5> tKoxSts 'wl'fah cyclic Colupins and 
unrepeated (balanced) Change-over where o=(ttl)/g 



3x2x6 fs2 
Row I (1) m 
^ 1 
IV fl) (3) 

2 

balanoed 



5x2x10 f,rl 
low’ I (iV (2) 
A 1 

VI (1) (4) 

3 

unrepeated 



5x3x10 * 
none 



9x4x18 a 3 

Row I (1) (2) UY (Q) 

A 12 4 

X (1) (6) (3) (2) 

A 5 6 8 

unrepeated 



9x5x18 fs5 13x6x26 f,5 

Row I (1) (2) (4) (7) (3) Row I (l) (2) (4) (7) (11) (3) 
- A 12 3 5 A 1 2 J 5 

X (1) (9) (6) (4) (8) XIV (1) (9) (tTTi3T (11) (7) 
A 8674 A 8 10 7 11 9 

balanced vinrepeated 



13x7x26 fi7 

Row I (T7 Tal Txr’dri U) (9) (7) 

A 1 2 7 5 6 11 

XIV (1) (Q) (6) (a) (5) (4) (8) 

A 8 10 9 3 12 4 

balanced 



17x8x34 tm7 

Howl (1) (2) (4) (7) (11) (16) (5) (12) 
12 3 „ 4 _ 5 6_ 7 

XVIII (1) (9) (6) (5) (15) (7) (^) (17) 
A 8 14 16 10 9 12 15 

unrepeated 



17x9x34 tm9 

Row I T i3Ti ) ( 7> ( 8 ) ( TiT f 9 ) ( i7TTi 3T7io1 

^ ^ 4 2 1 3 15 8 13 14 

XVn I ( 1 ) ( 1 3 ) ( 3 ) ( 12 ) ( 6 ) f 11 ^( 17 ) ( 16 ) ( 9 ) 
A 12 7 9 11 5 6 16 10 

balanced 



21x10x42 

Row I (I)(2)(4)(3)(6)(ia)(10)(l7)r9)(l ■ 

4 _ 1 2 2_0 3 6 19 7 13 4 

* Xm (1)(11)(6)(2)(14)(8)(17)(10)(15)(12) 
4 10 16 17 12 15 9 .14 5 18 

unrepeated 



21x11x42 f^n ^ 

Row I Til (2M4) (3y'(6) (11) f?) (14) (8) (17T ( 1 sT 
4 1 2 20 3 5 17 7 15 9 19 

XXII (1) am (18) (5) (2) (14) (3) (17) (21) (16) (3) 
A 11 6 8 18 12 10 14 4 16 13 

balstneed 



f?13 



RowT'TT) (29) (63 (12) (10) (15) (19) (13) (24) (17) (25) (16) 

A _ 28 6 2 1 3 27 5 4 23 n 22 . _ 8_, ,20. 

■ ra 'TiTlS) (5) (18) (7) (23) (197 (9) (2Tr(l3) (27) (is) (10) (20) 
A 7 26 13 IS 16 25 19 12 21 14 17 24 10 

unrepeated 



O 
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29x15x58 



Not completed 



f*15 
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*It Is possible to write the Design: 



5x3x10 f=3 

Row'll TiT ( 2) (¥) 

A 12 

VI (i) Tsi nr 

A U 2 



but the Change-over is unavoidedly repeated. A Treatment, say (l), is 
preceded by (t) twice and (3) not at all. So if there is any Carry-over 
it is confounded more than one would like with direct Treatment effect. 
Accordingly, if something of this sort must be used, one or the 
other halves of this Design may be employed and the lameness made up in 
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It was earlier remarked that apparently the writing of cyclic single 
loudens with unrepeated Change-over would be extremely simple for t of 
almost any size, when t = 4m - 1, m an integer, and is prime. Unfortunately, 
the writing of comparable double Youdens, when t = 4m + 1 and is prime, 
is not so simple; to write the second half is hard. 

Double Youdens, non-central — There seem to exist very 'few double-cyclic 
Youdens, with unrepeated Change-over, other than those of Table XVIll. It 
might have been anticipated that there would be, further, a series of 
double Youdens, of desired character, with f - 1 , in analog with single 
Youdens. In fact, there are but two — 5x2x10 of Table XVIII and 

13x3x26 fal 

Itew 1 (T) (H 

A 2 6 _ 

XIV (1) (5) (4) 

-A 4 12 

unrepeated 

but 25x4x50, f=l, cannot be written in 4 Columns of 25 Treatments, twice over- 
there is no solution — this by exhaustive examination. Hiis seems a little 
curious when we consider the series for single Youdens where f = 1 • Hie 
next member of the series, 41x5x82, f = 1 was not investigated. , There 
are, of course, no double Youdens with f = 2 ; f is necessarily odd. Double 
Youdens where f = 5 can be conceived as belonging to the series, 5x3x10, 
9x4x18 , 21x6x42, 29 xffx 58 , etc,, f = 3 . Hie first 2 members belong to 
earlier series and for each of them a double Youden Design with cyclic 
Columns and unrepeated Change-over exists and has already been shovm. Exhaus- 
tive exploration of the double Youden 21x6x42 showed there is no Design with 
cyclic Columns J' ; Hie Design for 293ffx58 ‘was not explored eidiaustively. 



O 
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Foi* the intractable double Youdens, with c small as In 25x4x50 
and 21x6x42 j there should be found, if that is the best that can be done, 
solutions where the Treatments are not cyclic In the Columns but the Change- 
over is unrepeated. Something like the Design of Table XVa for l 6 x 6 xl 6 
is required. 

Whenever it is possible to ■write a Youden square with cyclic Columns 
as t X c X t then it is possible to write a conjugate Design t x (t - c ) 
Thus the Design 15x10x26, f - 15 , conjugate to 13x3x26 can be written easily 
enough. While, however, the Design for c < (t - l)/2 is useful that for 
t - c is unattractive. The number of Changes -ever must exceed the number 
of Treatments, but not be an integer multiplier of that number. Thus 
23x10x26 must have l 8 Changes -over when there are only 12 different, so that 
6 Changes -over must be repeats. For such a situation we shall not attempt to 
find a Design. It would not be worthwhile or of practical value, ■ 

Single Change-over - The general lines on which single Change-over Designs, 
vterm Treatments are paired within an experimental unit, are ■sfrltten were 
Indicated at the time of their Introduction in Chap. I. They will not be 
listed in particular like the higher Youden Designs. To recapitulate, for 
t odd one may write along the lines of the model for t - 5 , as 





5^x10 f * 1 


Row I 


(1) 


(2) 


t 




1 


VI 


(1) 


(4) 


L 




3 



Here every comparison occurs once, f = 1, and each Treatment (1) through ( 5 ) 
occurs equally in each Column, Autonmtically, the Change-over is unrepeated 
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although necessarily unbalanced^ If bal^-iced Change-over is desired for t 

♦ , 

odd, and there are enough Rows possible, such may be achieved by some Design 



along the 


lines 


appropriate for 




5x2x20 f - 2 


. Row T 


TTF^ 


(2) 




A 


1 




{i) ^ 


(3) 




A 


2 


■ "jnr 


(X) 


(4) 




A 


3 


XVI 


(1) 


(5) 




-4^ 


4 



In order to get a given Treatni.ent the Bame number of times in each Column 
for t even it is necessary to ■write a larger Design which is most conveniently 
in the form, as for t = 4: 



4xgxl2 fs2 



tow I 


TTT 

A 


(2) 

1 


V 


(1) 


(3) 




4 


2 


IX 


(1) 


(4) 






3 



which has, automatically and always, balanced Change-over. 
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V. Analysis of data from latln squayes 

Special features of the latln sq^uare 

Analysis for direct Treatment effects in a single latin square 
Analysis for direct affects in repeated Design 

Breaking treatment variability up 

Analysis with allowance for Carry«over in latln squares with 
conditioning Period 

Analysis with allowance for Carry-over in latin squares without 
conditioning Period . , 

Explicit solution for simple cases of Carry-over . , 

Latin squares with mlaslng Rowra 

Latin squares with missing cells 



I 
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109 
122 

128 

. 146 

156 
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171 
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Special features of the latln square - Latin squares are design-wise a very 
special case of Youdens. Not only for this reason are they worthy of some 
special attention but they are, of course, widely known and commonly employed. 
They are a very desirable design for change-over experiments provided that t 
the number of Columns, or conmonly the amount of time required. Is practical. 
The latin squares are easily understood by men innocent of Statistics and 
are easily analyzed. As, however, t becomes great, Youden rectangles, 
c < t , have to be employed , 

The peculiarity of latln squares is that the experiment is so organized 
that one *s estimate of any effect, be it in Row, Column or Treatment, contains, 
in a nice balanced way, all other possible effects. Thus a given Row con- 
tains an item in each Column once, and once only, and each Treatment once, 
and once only. Similarly, a given Treatment is represented in each Row 
once, and once only, and in each Column once, and once only. Similarly, is 
the effect of a Column disposed. Rows, Columns and Treatments are said to be 
orthogonal. This orthogonality accounts for many of the steps that are taken 
in handling 2.atin squares and in tlia form in which their analysis is presented. 
Unfortunately, people have tried to extend those steps and that form to cases 
when the effects are not orthogonal and the arithmetic contortions are extreme. 

The data from a single latin square, with or without consideration 
for Carry-over, may be analyzed by the procedure appropriate for Youdens 
in general. These methods are developed and Illustrated at length in the 
subsequent discussion and a program for electronic computer is shown in 
the Appendix. All er natively. It may be analyzed by special methods, i.e., 
analysis of variance, whiah are widely shown in the literature and are 
perhaps more simple than those appropriate to Youdens, in general. Let us 
say that they are the more simple so long as Carry-over is not involved. 
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To soiiie extenlj "bhe procodui'e chosen vrill depend on “bhe background of hhe 
bionie^'riclan and^ “to some exten'b^ on "bhe eqp.ipM.en'b available "bo him. He may 
use the general Youden prograni^ if this is convenaent as in a program, on an 
electronic computer. Why bother with a special prograin, for the latin square? 
If the businesE must be done on a desk calculator ^ he is more likely to use 
the special methods, which were, after all, designed for a desk calculator 
or even for pencil work in 1925 • 



Analysis for direct Treatment effects in single latin square - Ihe 
traditional analysis of data, for direct treatment effects, from a latin 
square is very well known. Let us then record it briefly and illustrate 
it with the data of Table VI, a 6x6x6. It happens to have balanced 
Carry-over, as was taken up when the Design was Introduced, and to be 
arranged with constant forward differences as in Table IX. As was dis- 
cussed in connection with that this is effectively the same thing as 
Treatments cyclic in Columns, none of these things is, howevei', of moment 
in the analysis for direct effects. 

In the traditional approach that we are discussing it is usual to 
conceive the 36 observations to be something like 



= V a * 6 + Yi, + 






(7) 



where y is a general constant, is the effect of the 1 



.th 



(l - l...t) Row, 6. of the J 

J 



th 



, th 



Treatment and, e.., 

ijk 

cell of Table XIX 



(j = l..,t) Column, k''” (k = l...t) 
the effect of extraneous factors. Thus in the 9th 







7236 = 64.2 

= M + a2 + 3s + Y6 ^9 



( 8 ) 



where a£ is the effect of the second Row, where the ohservation occurred , 

3s is the effect of the third Column, yg 'the effect of the sixth Treatment* 
It is usual to assume that e. is normal, distrihuted with standard devia- 

1 JiC 

tion a about zero. (The meaning oT this matters little.) It is assiaried 

that the values of e. are uncorrelated. It is further supposed that 

1 JK 



t 

E 

i=l 



a . 

1 



t 

E 

j=l 



3. 



t 

= E 
k=l 



Yr 



0 ■ 



(9 ) 



This last eq.uation is of the greatest importance for it is constantly 
appealed to in subsequent discussion. It must be noted that the whole 
structure of traditional analysis of latin squares is based upon the 
additive assumption of Equ. (T). Whether they are additive is not usually 
investigated. We can only say that the model seems to have worked out 
well in an historic way. 

On the basis of Equ. (j) and (9)s the estimates usual in a latin square 
may be written very simply in terms of totals for a given Row, Column, 
Treatment or overall, respectively of 



T. 

1 


= 1 


( i 


common ) ^ 








T. 

J 


= 1 ^ijk 


( j 


common ) 






(10) 
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common ) 
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The estimate of the general level of response is 



2 



( 11 ) 



y = Q/t 



The estimate of the effect of the k. 



Tr e atme n t is 



V or (k) - (T, /t) - G/t^ 



( 12 ) 



i.e.j the estimate of the effect of the k Treatment Is the average for 
all observations under that Treatment .less the average G/t^ , for all 



observations. This is what is known as a least squares estimate although 
let us not bother here what that means or why we should want it. Let us 
simply comfort ourselves in the fact that most statistical estimates are best 
made by setting up least squares estimates. Even when more general methods 
of estimating are used^ they usually include least squares method for some 
special case. The actual estimates for Treatments are shown in Table XIKb. 
They are labelled oontributlons j they are often thought of as the amount 
each mean differs from y . The means or averages are quantities often 
more useful for practical reporting. Equations similar to Equ. (l2) can be 
Witten for Row and Columns if they should be needed. 

A matter of more difficulty , although of less consequence than is 
often supposed, is that of calculating the sigilficance of the variability 
among treatment averages. The question is whether they vary as much as they 
do Just by accident, as Judged from the general Instability of the ej^eri- 
mental results. Traditionally, there is found the reduction In variability, 
or as it is called, the sums of squares, due to Rows, Columns and Treatments 
respectively from 
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R 



t 

(t Z T? - Q^)/t^ 
1=1 ^ 



S 



C 



t 

= (t Z t 2 

j=i ■> 






S 



T 



k 

(t L tJ 
k=l ^ 



G2)/t2 






( 13) 



hat is called the total sum of squares is found as 

S = (t^E y? - G2)/t2 . a4 ) 

G _^2 IJk 

Finally there is found the residual variability or that due to extraneous 
factors (which is often called the sum of squares for error)l.e.3 



= S„ - S„ - S 



G 



R 



T 



( 15 ) 



lach Bvm of squares has associa'ted with it what is called the degrees of 
‘reedom. TOiese are one less than the niamher of items involved. Thus 3 
ince there are 6 Treatments there are 5 degrees of freedom* The reduction 
y unity is associated with the conditions of Equ. ( g ). The analysis of 
urns of squares together with the analysis of mean squares 3 or the 
.nalysis of variance 3 is as shown in Table XIX, Values of F , for testing 
ignificancas are found by dividing error mean square Into mean square for 
ach of the superior lines. These values are referred to Table L. This 

S3 of course 3 a very well-known tests it is to the point that the estimate 
f random standard error from among say Treatments is greater than from 
rror to a degree that could hardly happen by accident. Hence we argue 
mt the estimates of Treatments vary more than could reasonably be 
scpected by chance. Just where one draws the line is to some extent a 
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liable XIX- Analysis of latln square for dir;^ot 
treatment effects only 
a. Data collected, repeated from Table VI 



Week 



Group 


0 


1 


2 


3 


4 


5 


6 


Sum 


Mean 


I 


((D) 


(l)U 6 D 


( 3 ) 45.8 


( 2 ) 40.8 


(5)62.4 


(6)59.9 


( 4 ) 61.7 


317.0 


52.8 


II 


(( 2 )) 


(2)60.9 


( 4 ) 59.2 


( 3 ) 44.9 


( 6 ) 64.2 


(1)55.3 


(5)52.0 


336.5 


56.1 


III 


(( 3 )) 


( 3 ) 50.0 


( 5 ) 50.0 


( 4 ) 64.2 


(1)60.9 


( 2 ) 58.4 


(6)53.3 


336.8 


56.1 


IV 


iik )) 


( 4 ) 63 . T 


( 6 ) 72.0 


(5)71.7 


(2)57.3 


(3)53.3 


(1)52.7 


370.7 


61.8 


V 


(( 5 )) 


( 5 ) 48.8 


( 1 ) 50.4 


(6)56.4 


(3)58.9 


( 4 ) 65.6 


( 2 ) 64.2 


344.3 


57-4 


VI 


(( 6 )) 


( 6 ) 63.2 


( 2 ) 58.7 


(1)51.8 


D) 49.6 


(5)49.6 


( 3 ) 53.6 


326.5 


54.4 


Sim 




333.0 


336.1 


329.8 


353.3 


342.1 


337.5 


2031.8 




Mean 1 




55.5 


56.0 


55.0 


58.9 


57.0 


56.2 




56.4 




t. 


Treatment estimates 


- 
















Dll , 


HI 


iil 


( 4 ) 


( 5 ) 


A 

( 6 ) 






ContrilD, 


- 3.52 


+.28 


-5.36 


+4.23 


-.69 


+5 . 06 






Mean 


52.92 


56.72 


51.08 


60.67 


55.75 


61.50 






Sim 


317.5 


340.3 


306.5 


364.0 


334.5 


369.0 





c. Traditional analysis of varla.nce 



Source 


d.f . 


Sum Squaras 


Mean Sauare 


Rows 


t-1 


Sr 


Sj^/(t-l) 


Columns 


t-1 


®c 


SQ/(t-l) 


Treatments 


t-1 


St 




Residual 


(t-l)(t-2) 


Se 


S^/(t-l)(t-2) 


Total 


t2-l 


s 








G 





O 
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Source 


d.f. 


Sum Squares 


Mean Square 


F 


Rows or Group B 


5 


280.5856 


■ 56.1171 


1.04 N.S. 


Columns or Weeks 


5 


57.4322 


11.4864 


.21 N.S. 


Treatments 


5 


510.7722 


102.1544 


1.90 N.S. 


Residual 


20 


1074.9356 


53.7468 




'‘Total” 


35 


1923.7256 


i 





d. General and reasonable analysis for significance 



Factors 



5 Rows & Colunms (control) 
Control factors plus Treatment 



d.f . 



Residual Variability 
( Squares ) 



1585 .7078 
107i+.9356 



.20 



( 1585.7078 - 107 ^ • 9356 )/(Sg-aO) = n gn W S 
lOTU. 9356/2:0 I.yu R.b 




. \ 
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ma'b'ber of* disposition. Usually it is drawn at 5^5 'we say there is only one 
chance in 20 that the variability among Treatnients could be so great. As 
is^ however, shown in Table L, one may draw the line at Iffo or .1^. 

It may be noted that Table XlXd has been added for the sake of 
comparison with subseq^uent work, although its supporting discussion is 
necessarily deferred. The quantity 107^.9356 is easily recognizable in 
Table XIXc and the quantity I 585.7078 = 1074.9356 + 510.7722. 

The ideal of classical experimental design is that the several categor- 
ies of a situation are so disposed that their effects are entirely uncon— 
fused or orthogonal and are readily estimated free of each other. The 
eategories may be Men, Periods and Treatments. In the earliest Designs to 
appear, historically, i.e., the latin square, all Men are present in each 
Period and try all Treatments. Then one can form a tidy 3-dimension table. 

In saying that the systematic elements. Rows, Col um ns and Treatments are 
orthogonal, we mean that if one were systematically to add soniething to any 
one of them the relative standing of the others would be unaffected. Thus, if 
in Table VI, some ill-disposed person were to add 12 to all observations 
in Row or Group I, but there only, the data would become.' 



Week 



Groups 




1 




2 




3 




4 




5 




6 


I 


(1) 


58.4 


(3) 


57.8 


(2) 


52.8 


(5) 


74.4 


( 6 ) 


TI .9 


(4) 


73.7 


II 


( 2 ) 


60.9 


(4) 


59.2 


(3) 


44.9 


(6) 


64.2 


(1) 


55.3 


(5) 


52.0 


III 


(3) 


50.0 


(5) 


50.0 


(4) 


64.2 


(1) 


60.9 


(2) 


58.4 


(6) 


53.3 



etc. etc. 



The mean for Group I would, of course, be Increased by 12 and the contri- 
butions for Groups would be generally disturbed. Then the treatment 
means and contributions would be 
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( 1 ) 




A 

_ 13) 


A 

(4) 


A 

(5) 


A 

( 6 ) 


Mean 


54.92 


58. T2 


53.08 


62.67 


57.75 


63.50 


Contrib . 


-3.52 


+ .28 


' -5.36 


+4 , 23 


-.69 


+ 5.06 



The ineftiis have heeii incifeasecl Tsy 2 over 'whai they should, have heen froni 
Table VI but it can be seen that the treatment contributions are quite 
unaffected from their values in Table XIX. Treatment is orthogonal to Group, 
The quality of orthogonality is very important to the latin square. 

It is for this reason that the effects of the categories are found simply 

as the marginal averages. The problem of determinli.g significances as 
illustrated above, is correspondingly simple. Unfortunately, in the real 
•world to be discussed in following chapters, the effects are rarely 
orthogonal. So both the business of estimating effects and testing 
significance has to be looked at in a more serious way. This is done below. 

The procedure of Table XlXc as traditionally carried out to make an 
analysis of ■variance •was in 1925 singularly fresh and powerful but in the 
year of this ■writing (the 44th year of statistical grace) it seems more 

than a little stilted aijd a'wkward. In the first place it makes no distlnc- 

■feion bet'ween the control factors. Rows and Columns and the experimental 
factor. Treatments, that is to be tested, UsuallRy we do not "want to know 
the effects, in themselves, of Groups or Periods but simply ■want to get 
them out of the picture. They may be regarded as factors neceasary for the 
experimental control of variability. A novice could hardly realize this 



beoa'use these estimates or the mean squares tha’b correspond to them are 
handled in .exactljr the sarnie way as those for Treatments which are of prime 
Interest. In a cautionary ■way, it may he added that circumstances do control 
cas^s and if anyone should ■want to know the significance of Rows or Columns 
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it can be handled in exactly the same way as that for Treatments or Carries - 
over. The procedure is Illustrated for one problem, that of Table X5CKIII 
which deals with the full and what seeina best method of analysis for Youden 
rectangles. In the second place the concept that has been called residual 
variability is commonly called "error." The concept of "error" apparently 
comes from the physical sciences where all relationships are supposed to be 
in functions (particularly If one leave out the aberrant observations). 'What 
passes for error is perhaps best thought of as the effect of extraneous factors. 
It is variability in the results, y , that cannot be accounted for by the 
classification of data into Rows, Columns, Trealments and possibly Carry-over. 

There is a curious effect that is encountered fairly regularly in change- 
over experiments when they are subject to considerable Carry-over and that Is 
that the Colinnns or Periods seem too uniform. This can be seen in Table XKc 
which is full analysis of variance. The effect of Columns or Weeks is 
taken out as if it were an experimental factor and required testing for sig- 
nificance. It will be seen that its "mean square" is only 11,49 in contrast 
to residual, mean square of 55. 75- Such happens pretty regularly. The reason 
seems to be that since each Treatment occurs once and once only In the preced- 
ing Column, therefore, each Carry-over occurs once and once only in the given 
Column. The same is true in all Columns and accordingly the Carry-over con- 
tributes not at all to the variation among Columns . It may, howevei’, be 
contributing very heavily to the residual variability, which may thus be the 
greater when no allowance is made for Carry-over. 

Analysis for direct affects in repeated Design - In practice one often 'sets 
up multiple latln squares (t even), l.e,, repeated in the sense of the present 
discussion and by this we mean not that a given Treatment is repeated, or 
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as is generally s£iid. replicated^ but the whole square may repeated. 

Thus one may set up a Design^ from Table on h Groups of men as follows* 



Period 



Group 


1 


2 


3 


4 


I 


(1) 


( 2 ) 


( 3 ) 


(4) 


II 


(2) 


w 


( 1 ) 


(3) 


III 


(3) 


(I) 


(4) 


(2) 


IV 


{h) 


( 3 ) 


(2) 


(1) 



and then repeat this 5 times so that 20 Groups of men are covered s as has 
been done in Table 3DC* It is 5 of eQurse, realized that it would be some- 
what more sophisticated to give each fresh set of ^ Groups a fresh Design^ 

BO far as possible. It would even probably yield bettei'* results. The 
stumbling block is one of practicality- It is better not to write out 
elaborate instructions for other people to execute and tha^ will require 
proofing by the writer . Also in actual praetiee the result would probably 
be incomplete in some way 5 with cells missing or even lines missing^ 
so that the total Design would than become quite intricate and its analysis 
involved. In Table 3QC which was chosen for Illustrative purposes^ the Design 
is corriplete. It will be noted that Table 3QCa is concluded by quantities 
with the label ’Bum sq." These are simply the sum of the squares of the 
observations 53 5 57 5 50 etc, in^ say g Column 1 and are added to save work later 
for anyone choosing to verify the calculations. Such quantities were shown 
at the foot of Table XlXa, 

The analysis for direct treatment effects in paired latln squares ^ 

2( t X t X t )g as in Table X-, which oocvir when t is odd^ mustg of 
course, be just the same as in a once repeated latin square Design, 
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It is possible to make for this situation of multiple latin squares an 
analysis of variance very similar to that for single latin squares, as shown 
in Table XXd. Such is, indeed, the general procedure in the literature. 

This analysis has no longer, however, the justification of convenience. Its 
generalizatibn leads to increasing complications to the point where, for the 
more Intractable cases that arise in practice, analysis becomes Impossible. 
Accordingly, it seems best to turn in the direction of methods suitable for 
this and all later problems. It is assumed that a fundamental structure of 
general row, column, treatment and extraneous effects exists as in Equ. (7) 
and that row, column and treatment effects add to zero, as in Equ. (9)» Now 
a man, reasonable, but innocent of Biometry, let alone the Calculus, required 
to form some estimate of the quantity u in Equ. (7 ) from the data of Table 
XK would presumably proceed along a line of thought that may be conjured up. 

He would argue that in view of Equ. (7) every one of the 80 observations in 
the table contains the quantity u so that none may be safely ignored without 
throwing away a potential bit of Information on u . Siurelyr the sum or the 
average of the 80 observations would give him some idea of P ? Now starting 
out to consider what we get besides u in the sum he would find 



53 = y + ai + Bi + Y1 + £l 

58 = p + oti + 02 Y2 

58 ^ p + aj + @3 + Y 3 ■*' 63 

r 

53 - y + «! + 64 + Y4 + E4 

57 - y + U 2 + 01 + Yl + 65 

55 = y + U 2 + 02 +' Y2 + 66 



58 = y + U20 + 04 + Yl + ^80 



O 




(16) 
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whence 

80)J + 4(aj + a 2 + a 3 O2o) 2O(0x + 02 + 63 + 84 ) + 20(yi Y2 + Y3 Yi*) 

+ £l + £2 + £3 • •+ ^80 

= 4241 ( 17 ) 

Upon reflection^ remembering Eq,u. ( 9 )} he would simplify and say 

80 y + + Eg + Eg ... + Eqq = 4241 . ( 18 ) 

Now since, as can be shown, there is no sure way of estimating 5 ^2 - 

Eg etc. he could only hope they would to a considerable extent cancel, 
some being positive and some negative, and otherwise forget them. So finally 
he would come to the comfortable , 

8 OU = 4241 ( 19 ) 

which, of course, results in the average 

0 = 53.01 ( 20 ) 

(Note the little hat means that even when a.Tl is done he would not know 
U , but only have an estimate subject to accidental variations.) Next 
suppose the reasonable man wanted to get an estimate of the control factor 
of Group. He would first estimate the level of satisfaction for Group I, 

He would argue that in view of Equ. (j) every one of the first 6 observations 
in the table contains the quantity so that none may be safely ignored 

without throwing away a potential bit of information on , Surely the sum 

or the average of the first 6 observations would give him some idea of ? 
Now, starting out to consider what he would get besides 
the first four of Equ. (16), 






in the sum, from 
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222 - 4 y + + 02 + ^3 + 84) + (yi + Y2 + Y 3 + Y4)+ ei + £2+ ej + £4 

(21) 

or upon reflection, rememliering Eq^u. ( 9) he would say 

4 oi + 4 y + ej + £2 + £3 + 64 = 222 . (22) 

Now since, again, the only thing he can do with Ej , E2 etc. is drop 
them and write comfortahly 

4 ai + 4 y = 222 . (23) 



Let him then wi‘ite for Group I through XX, the equations: 

4ai + 4y = 222 
402 + 4y = 211 
4a 3 + 4y = 226 
4q 4 + 4y - 225 
^“20 + 4y = 220 J 



(24) 



In more or less the same way he would get equations for the control factor 
of Period as 



208 1 + 20y - 1121 ' 

2082 + 20y - 1048 

2083 + 20y = 1029 

A ¥\ 

20 64 + 20y - 1043 j 
In this way he would get estimates : 

^ A « ^ ^ ^ 

^2 ^3 ‘ 

+2,49 *.26 +3»49 +3 .24 +1.99 

f • 

81 32 83 64 

+3.o4 -.61 -1.56 “*86 



(25) 



(26) 
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By a similar argument, he would get equations for the experimental Treat- 
ments as follows : 



yielding estimates of Treatment effects, as in Tahle XX b, All the treat- 
ment eatimates, or contributions, Yv shown in Table XX b as (h) , 

it 

which is a more comrenient way of reporting them. As previously In Table XlXb, 
there are added the means for the Treatments, 

It must seem that in the preceding passage a mountain has labored 
mightily to bring forth a very small mouse. The point of view is Important 
hecause It applies to later cases of more Involved design or imperfectly 
executed design. One can set up quite easily oneself what are called 
"least squares" estimates for all the effects in a latin square without 
getting all involved In the elaborate business of partial differentiation 
usually given in their derivation. These equations are, at least for all 
problems in the present book, very easily set up along lines that a reason- 
able man would follow anyhcw. For a given Treatment he would form the 
total or average result, although we do adjust it a little for any effect 
of Rows, Columns^ etc. i which happened to become Involved from the nature 
of the, Design. This approach, it should be understood clearly, leads to 
results identical with those usual. ®ie approach is convenient and meaning- 
ful in an experimental wajr. 



20yi + 20y = lOi+0 



20y 2 + 20p == 1075 




y 



(27) 
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While estimates of treatment effects should probably be considered 
the main output of an experiment, such as that of Table XX, l.e., the 
I’esults of Table XXb, it is often important to test the significance of 
those estimates. Important or no it is generally done as in Table XXc . 

It is often necessary to go beyond these and the estimates of effects 
as in Equ. ( 26 ), to the question of the chance variation in these 
estimates and the general chance variation In the observations that is not 
accounted for by the systematic effects. Here the intuition of the 



reasonable man would be inadequate and it would be necesBary for him to 
appeal to a biometrician. And this Is a good thing because it makes it 
possible for biometricians to earn a living. With regard to the residual 
variability it is necessaiy to thlnlt of the problem in two steps. Eirst, 
what would be the residual variability If one made allowance only for the 
control factors , Rows and Columns , and secondly if one made allowance for 
the factor of experimental Treatment. The vital question is whether it 
is much reduced by the inclusion of Treatments because then we shall be 
inclined to regard them et significant. 



Consider the first problem of getting the variability, residual on 
the control factors. Here we me.y take advantage of a rule without attempt- 
ing to justify. It is that for all least squares equations and their solu- 
tions, the variability, in a certain sense j that is not explained, is gotten 
from the sum of the 80 observations in Table XXa, each squared (229,057 )> 



the above estimates and the right-hand members of the equations. Then one 
takes advantage of the fact that the reduction in squares achieved by each 



estimate is given by the product of that estimate and the right-hand member 



of the equation from which it arises. Thus the reduction in variability, due 
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to vhe introduction of y , is -53.01(4241) as from Eq.u. ( 19 ), the reduction 
due to Is -2.49(222) as from Eq.u. ( 24) ^ the reduotion due to 
is -3.04(1121) as from Equ. (25). In total the Tariabllitjr residual on 
control variabl s (employing row and column estimates beyond, those of 
Eq.u. ( 24) and (25) and not shown elsewhere) is: 

229,057 - 53.01(4241) 

-{+ 2 . 49 ( 222 ) - . 26 ( 211 )+ - 3 . 49 ( 226 ) + 3.24(225) + 2.99(224)+ 2.74(223) 
+4.49(230) + 2 . 49 ( 222 ) - 6 . 26 ( 187 ) + 4.74(231) - 2 . 76 ( 201 ) - 6 . 0 l(l 88 ) 
- 3 . 76 ( 197 ) + 2.24(221) + .49(214) - 9 . 76 ( 173 ),- 2.26(203) + 5.49(234) 
- 5 . 76 ( 189 ) 1 . 99 ( 220 },} 

-{+3.04(1121 - .61(1048) - 1 . 56 ( 1029 ) - .86(1043)} 

^ 2507.91 ^3^ 

This result is exact, except for rounding error, due to the fact that in the 
illustrative calculations there are very few decimal places. If the business 
is carried out with abundant decimal places the result of Equ. (28) is 
2518 . 5 I; as in Table 3QCc. 

Finally, we must considcf’ the variability reslclual on the model when 
not only control factors, but also the experimental factors or Treatments, 
are included in the model for the data of Table 3QC . Since the effect of 
Treatments is orthogonal, on account of the peculiar natTjre of the Design, 

*The reader should not be alarmed that some row estimates Beem to give 
an increase, rather than a decrease. In residual variability. Matters are 
arranged so that Rorws, as a whole. Columns, as a whole, and Treatments, as 
a whole, give each a reduction in variability. 
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to those of Rows and Cor'nnns, l.e.^ the various equations are independent, 
we may write the further reduction due to the consideration of Treatments, 
after the fashion of Equ. (1?) as suhtracted directly from th previous 
r 0 sid,iio.l "bo glv© a, final rosidiia,!^ of 

2507 . 91 - 1 - 1 . 01 ( 1040 ) . 74 ( 1075 ) + 1 . 59 ( 1092 ) - 1 . 31 ( 1034 )}= 2381.07 . (2C 

or if abundant decimal places are used to the 2402.27 of Table XXC;, where the 
results are sununari zed . There the mean .reduction in variability per degree 
of freedom for Treatment is (2518# 51 — 2U0*27)/3 — 38#T5 * The mean variability 
per degree of freedom residual to the entire model is 2402*27/5^ ^ 44-49 • 

The ratio of these quantities is called F — 38-75/44.49 = ‘S, , which is not 

significant n referral to Tabl L. 

It should be realiz;ed^ of course^ that exactly the result gotten by 
the classic Equ. (15) could Viave been obtr^ined by operations like those of 
Equ. (28) and ( 29 ). Equ. (15) 1 b Just a facilitation^ convenient for a desk 
calculator^ when one is dealing with a single complete latin square. It 
really does not matter how one analyzes--it is so easily done. It does not 
even matter much how one presents the analysis. Thus it can be presented in 
the classic way as in Table XDCc or in more concise but general manner as In 
XlXd, The approach is^ however^ important because the classical one becomes^ 
often^ unbearable in the more complicated cases that arise in the real world. 
Then the designs tend to be multiple^ incomplete and not latin and the 
analysis had better be done by setting up the necessary equations and then 
considering the amount of variability left in the data after those equations 
have been used to make necessary estimates 
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If one hT.d only a desk cc‘^ ^’^lator , one would use Equ. (lO) ’through 
Equ. { 15 ) j with a small modification in the definition of 3 to get the 

results shown in Table XX d. Ge.ierally in practice » however, research men 
would use the approach of Table XX c but take advantage of something like 
the appendix program. If one has access to an electronic computer It is 
much more simple Just to give it the Design and results, as in Table XX a 
and have it yield the results as in Table XX c . 

The writer suggests that this problem might more logically be thoiAght 
of along the lines used in fitting a polynomial of indeterminate order, as 
Sir Ronald Fisher also taught us in 1925* Argue that there Is a certain 



residual variability when allowance has been made for the control factors, 
i.e.. Rows and Columnt . Then consider the residual variability when allowance 
is further made for the Trealnents. Consider the reduction in residual 
variability due to the addition of Treatments. Compare that reduction with 
the •variability still residual to see ■whether the reduction due to Treat- 
ments is relatively so high that it could not be due to chance of the nature 
of the residual factors, i.e,, are the particular Treatments concerned very 
meaning ”ul. In all this handling about of residual variability it Is 
necessary to bear In mind degrees of freedom, as set forth in Table }QCc. 

We may say there were originally 80 degrees of freedom, i.e., 80 observa- 
tions, There have been fitted constants, 1 for p , 19= 20 - 1 for Rows 

and 5=4-1 for Columns, This leaves 80 -1-19- 3= 57 d.f. 
associated with the residual squares of 2 ^X 8. 51 on the control factors. 

Row if the model is extended to Include 3=4—1 more constants for Treat- 
ments there are left only 54 d.f, with associated residual squares of 
2402.27« There has been achieved a reduction in variability of 
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Table XX - Success In 20 Groups, -using k Treatments each for 



1 Week, during 4 Weeks 
a. Desl^ and results 



We el. 



Group 


1 






2 


3 




4 




Sijmi 


I 


(1) 


53 


(2) 


58 


(3) 


58 


(4) 


53 


222 


V 


(1) 


57 


(2) 


55 


(3) 


54 


(4) 


45 


211 


IX 


(1) 


50 


(2) 


66 


(3) 


57 


(4) 


53 


226 


XIII 


(1) 


6o 


(2) 


55 


(3) 


55 


(4) 


55 


225 

224 


XVII 


(1) 


64 


(2) 


52 


(3) 


49 


(4) 


59 


II , 


(2) 


6o 


(4) 


57 


(1) 


55 


(.3) 


51 


223 


VI 


(2) 


64 


(4) 


51 


(1) 


53 


(3) 


62 


230 


X 


(2^ 


53 


(4) 


58 


(1) 


51 


(3) 


60 


222 


XIV 


(2) 


55 


(4) 


44 


(1) 


48 


(3) 


4o 


187 


XVIII 


(2) 


57 


(4) 


64 


(1) 


53 


(3) 


57 


231 


III 


(3) 


77 


(1) 


47 


(4) 


30 


(2) 


47 


201 


VII 


(3) 


44 


(1) 


4q 


(4) 


48 


(2) 


47 


188 


XT 


(3) 


50 


(1) 


46 


(4) 


57 


(2) 


44 


197 


XV 


(3) 


63 


(1) 


51 


(4) 


52 


(2) 


55 


221 


XIX 


(3) 


62 


(1, 


42 


(4) 


56 


(2) 


54 


214 


IV 


(4) 


46 


(3) 


35 


(2) 


47 


(1) 


45 


173 


VIII 


(it) 


58 


(3) 


51 


(2) 


49 


(1) 


45 


203 


XII 


(it) 


54 


(3) 


63 


(2) 


51 


(1) 


66 


234 


XVI 


( U ) 


42 


(3) 


49 


(2) 


51 


(1) 


47 


189 


XX 


(4) 


52 


(3) 


55 


(2) 


55 


(1) 


58 


220 


Sum 


1121 




1048 


1029 


1043 


4241 


Sim sq,. 


64, 


075 


56 


,032 


53, 


633 


55,317 
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Td . Treatment estimates 



Contrib . 
Mean 



A 

-il) 

- 1.01 

52.00 




+.74 +1.59 

53.75 54.60 



(4) 

-1.31 

51.70 



c. Test of* significance of Treatment ef fects 



Factors 


d.f . 


Residual Variability 
( Squares ) 


y 3 Hows & Columns (control) 


57 


2518.51 


Control factors plus Treatments 


54 


21+02.27 



? - ( 2518 . 51 - 2402 . 27 ) /3 
2402.27/5U 



.87 N.S. 



d. Testing of significance using classic analysts of •variance 



Source 


d.f. 


Srm Sq . 


Mn . Sq . 


F 


Rows 


19 


1456.74 


76.67 




Columns 


3 


255.74 


85.25 




Treatments 


3 


116.24 


38.75 


.87 N.S, 


Residuals 


54 


2402.27 


44.49 




' Total " 


79 


4230.99 








A 
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2518.51 “ 2402.27 = 116.24 (as it appears in the traditio'^.al XX d) for 
3 d.f. or 38.75 per d.f. of Treatment. This is now to he contrasted with 
the 2402.27 residual variahility for 54 d.f. or 44. 4p per d.f. on the total 
model including control variables and Treatment. We contrast the 38.75 



with 44.49 by striking the ratio of .87. Finally we decide i± this is 
bigger than nilght the case by accident by reference to Table L 
(5l point of F) to see the number 2.71. Our .87 is too small. 

If we had gotten 2.71 or more in our experiment we should lave said the 
results were aigriiflcant . Then what may seem curious subtraction above 
of one from number of Rows, Columns and Treatments is due to the condition, 



Equ. (9^5 which reduces the real niamber of things to be estimated. Thus, 
In Equ. ( 24)5 it seems that there are 20 values of to be estimated 

but there are really only 19 because a2o is Jnst the sum of through 

ai 9 , multiplied by minus one. 

In the literatui'e one can find the solemn handling of the control 



factors, say Hows and Columns, as If they were es^erlmental Treatments, 
further elaborated for repeated latin squares. This position was first 
discussed in connection with the single latin square involved in Table XIX. 
The first 4 Groups, I, II, III and IV, may be regarded as belonging to a 
first square, the next 4 Groups, V, VI, VII and VIII, similarly belong to a 
second square. The Groups within a square may be more intimately related to 
one another than they are to other groups. In agrlciiltural problems where 
the analogue of our Group is a Row of little experimental plots such is 
often the case. Then there is piled up in place of the single line lead 
by "Rows" in Table XX d an elaborate subdivision of variability due to 
squares, the interaction of squares with Columns etc. The reduction in 
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variability (Sum Sq. ) due to Treatments and the corresponding value for 
Residuals are completely unaffected and the F test remains unaffected. 
Accordingly, such elaboration seems generally to be an idle thing. 

Breaking treatment variability up •* Very often data such as those of Table 
VI are subject to general analysis as in Table XDCa but then certain 
particular comparisons are required. The variability amr Treatments 
must be broken up. The point is that insofar as the Treatments make a 
substantial reduction in rusldual squaresj i.e., 1585 . 71^8 ~ 107^*9356 = 
51 c. 77 22 it is because the treatment averages in Table XIXc vary substan- 
tially. It may be required to isolate that variability because there was 
some fundamental reason, known before the experiment was run, why certain 
comparisons should be made. There is often a situatior where the variabil- 
ity aiuong Treatments must be in some way subdivided, Tne Treatments are 
not simply so many alternate van*ieties, in themselves. Thus it may be 
required to compare Treatments (l) and (2), which are two types of regular 
Treatment, with the other Treatments as a set because they are experimental. 
Alternatively, it may be required to compare Treatments (2) and (5) with 
(^)j ( 5 ) and (6) becsAise the first 2 involved aureomycin and the led.ter 5 
penicillin. The division for comparison may involve, in som way, all 6 
Treatments, although it may involve the intercomparison of only some. 

It is difficult and seems unnecessary, here, to go through the logic 
Involved in nuch probleins. We may advantageously avail ourselves of 
' procedures well established in the analysis of variance. Consider there 
the comparison of any set A of Treatments compared with ary other set 
B of Treatments. It is necessary to note the number of basic units 
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n. and in the two groups. In the case of e latin squai'e, txtxt, as 

A B 

at present, n. must be t times the number of Treatments in set A and 



”b 



is similar. Then the sum of squares or mean square is 



(T^r 



(T„)‘ 



n 



+ 



CT^ + Tj)' 



A 



n + 






(50) 



where T. is the total of all observations y in set A and T the 
A ■ h 

total in set B . Such comparisons may be made as the nature of the 
problem involved indicate. All such mean squares have a unit freedom. 
The matter may be illustrated on two comparisons of Treatments in Table 
XIX, or Table VI, by calculating: 



a. To Gompare Treatments (l) and (3) with all other Treatments find 



(6gli.0)^ (i40T.8)^ _ (2031.8)^ 

12 2h 36 



35H.6T 



(31) 



This mean square may be compared with the residual mean square of Table XlXd 
to give 



^1 20 " 354.6T/53.T5 = 6.^0 



(32) 



which on reference to Table L proves significant at the 5% level, 
b. To compare (2) and i3) with (4), (5) and (6) find 



(646.8)^ ^ ( 1067 . 5)‘ 



12 



18 



210.38 



(33) 



This mean square when compared with residual gives. 

2Q = 210.38/53.75 « 3.91 , 

which on reference to Table L is not significant at the % level, 
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(34) 
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This procedure may be paralleled by operations involving the estimates, 
as in Table XlXb, of Treatment effects. The procedure proposed is not 
exactly that usualby given in discussions of the analysis of variance, 
although it is algebraically identical. It has considerable advantages 
in that it can be applied in a variety of situations without any special 
concepts or eq_uations. It is, on the other hand, admittedly more clumsy 
for the case of the single, perfect latln Bq^uare. 

The set A , may be supposed to comprise Treatments and set B 

to comprise nig other Treatments. Then parallel to Equ. (30) -we may write 
that the sian of squares or mean square for the comparison of the two 
seta is 



where Z. is the total of treatment estimates for set A and Z^ the 
total for set B . The constant K is to be found, as below. Of course, 
from comparison of Iqu. (30) and (35) , for the single complete latin 
square, ,t is simply the number of experimental units under a given 
Treatment. In a more general way, K is the ratio of the reduction in 
residual sriiares due to Treatments, as in Table XKa, to the sum of all 
the treatment estimates squared, i.e,, 




(35) 



(l)2 + (2)2 -s* ( 3)2 + ( i ^)2 + (5)2 + (g)2 



Tile matter is illustrated for the case of Table XK in iqu. (56). 
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To illus'bra'be t;lie matter, consider the contributions of Table XlXb. 
We may find the value of 



K = 



1585.7078 - 1074.9356 



v(-3.52) + (+.28)' + (- 5 . 36 r + (+ij.23)-+ (-.69) + (+5.06)^ 



= 5.997 



(56 



or, as previously discussed, actually 6, the number, of observations under 
each Treatment, except for the fact that in the illustration the Treatment 
estimates', or contributions, are calc-ulated with only two decimal places. 
Following Eq,u. (35), the part of the variability 4ue to the comparison 
of set A , whe .1 it is Treatments (l) and (.2) with set B , when it is 
the balance of the Treatments , is 

J C(i) ^ ^ ((2 > * W * (h t (6))^ I 

12 h * 

- J 

when It will be noted that the third terai of Eq_u. (35 ) vanishes because 
the numerator sums to zero. Kumerically , 



, (-3.52 - 5.36)2 ^ .28'-. 69 + 5.06 + 4 . 23 )^ ^ 

2 k 

= I (6)(8.88)^ 

^ 33h.QkkB . ( 37 ) 



Now this value is to be compared with the final residual variability of 
Table XKa to give 



r ^ 354.81^48 

1,20 107^,9356/20 



6.60 



(38) 



which on reference to Table L is significant at the 3% level. This 



O 



result is. of oourse. identical .itn that of E^u. (32). e^ccept for rounding 
error. In the ease of the comparison between Treatments (2) and (3) with 
(h). (5) and (6). the part of the variability due to this single oomparlson is 

f (ih t (3)^2 ^ t (?) t (6))^ . r(0) t (3) t (b) t (i) t ,(6j}j 

'S f^ ^ » 



K 



( 39 ) 



i.e., there is a third, "corrective" term within the complex brackets . Thus 
from Table XlXb, again, the comparison yields 



6 { 



U ,PR--q.^6 + i^+_4,23:^r69 + q.Qgj- 



(+ .28-5.36 + U. 23 - .69 + 5.06 Iji y 



5 



= 210. 4'fO? • 

sow this value is to be compared with the final residual 

Table XlXa to give 



( 40 ) 



variability of 



210 . 4 T 0 T 



,20 10T^*9356/20 



= 3.92 



which on reference to Tahle L proves not significant. This result 
of course, identical with that of Eq,u. (3^*). except for rounding error. 

In actual experimentation, there frequent^ arises the problem where 
some one picks out, after the fact, of Table XlXb the most divergent 

ment. lihe (3) at -5.36. and compares it with the balance of the Treatments, 
The calculation is simple enough, being along the lines previously followed 

to give 



O 
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^ 6 ( 6 )( 5 . 36 )^( 20 ) 

^ 1,20 “ 107^.9356(5) 

( 1 + 2 ) 

= 3.85 . 



There arises, however, a problem of testing this value for significance. 
It is a problem In logic. The quantity Fq.go , referred in a 



simple way to Table L if we deliberately chose 5.56 on account of its 
being large; we did not predesignate it. Kiere is a .considerable discus- 
sion on this matter in the liternbure although it will be found to center 
around the quantity which is called "Student's.” (Wie choice 

of symbols has no great significance but is an historic accident.. ) To 
anyone interested in this question we recommend a search of the literature 

on this logical problem. 

There are subdlyisions of the variability among Treatments, other than 
the comparisons just detailed. For instance there are factorial experi- 
ments where 5 chemicals are tried each at 2 concentrations to produce 6 
Treatments. One may want, as it is said, to study the effects of the 
factor of kind of reagent, the factor of concentration and possible inter- 
action of these two factors. Such matters are covered in all standard 
discussions of e^erlmentatlon and should not be allowed to divert us 
from more Immediate business. Suffice it to say that in such discussions 
the sums given may be Judiciously replaced by estimates and then the 
value K used to adjust matters. 
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Analysis •wl'fali a,ll,owa,n.ce foy Car^y— oygr In latin sq^uayss xfilph cond.l'fcioni.ng 
Period - In Chap. II^ as In connection with Table VI, It was suggested that 
Carry-over of Treatment effects may oftfcen be considerable. On this basis 
the Designs presented and discussad have made allowance for Change-over. 
That is a given Treatment is not preceded by any other Treatment more than 
once. With such Designs we may at least comfort ourselves that Carry-over, 
if it occurs, will be confounded in a small and presumably minimal way with 
Treatinent effects. The matter often stops there. It may, however, be neces 
sary to free treatment effects from Carry-over, It may further be required 
no get Carry-over out of the residual mean square; Carry-over blows this up. 
There are even times when it Is of great practical importance to estimate 
the effect of Change-over. Thus we are often under the necessity of analyz- 
ing for Change-over. Consider first the situation when the Design contains 
a conditioning Period, as In Table VI, and as reproduced in Table XXIa, so 
that there are Carries -over in the first Period of the experiment, proper, 
Just as in the subsequent Periods . 

It is necessary to extend, for Columns after the first, the more 
usual model for a latin square as given in Equ. (7) to 



1 J -k Z IJkZ 



(h3'j 



where the i 



,th- 



Row, 



,th 



Column. 



th 



^k’eatment , and Carry 



over are Involved with extraneous variability, e 
supposed, as In Equ. 



of some kind. It is 



t 

E fio “ 0 . 

1*1 ^ 



C4W 
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Thus ail observation y2364 is conceived as being like 7236 ^ ) 

except that "we recognizes additionally, that the 9 th result Bh,2 followed 

Treatment (^), i.e., possibly contains Carry-over, 64 . The variability 

extraneous to the effect of all four factors In this particular cell is 

e. . It Is now possible to build again estimates of the various effects 

ijkA 

and the amount of variability residual on them- There does arise a question 
as to whether we are trying to test the significance of carry-over effects 
or simply to eliminate them in the same way as the effect of Raws and Columns. 
Then, of course, we may do, and shall do in the following discussion, both, 
one at a time. Again, it must be noted that the following discussion of 
Carry-over is based upon the additive model of Equ. ('^3). In this it 
parallels the traditional analysis of variance built on the same sort of 
assumption. There is perhaps a little more reason to question the assumption 
in the more elaborate model but it will not be done in the present book. 

It may be now observed that there is a reward for the primitive 
approach to the writing of least squai’es equations as set forth previously 

in connection with the multiple latln square, without consideration 
of possible Carry-over. There are no well-kricwn solutions for the present 
effects. The procedm’e In the literature involves the calculation of 
an elaborate set of preliminary quantities and their labyrinthine 
manipulation. Our reasonable but uninstructed mrui would siraunv 
form the obvious and appropriate totals and get exactly the right effects. 
Thus he would argue that the sum of all the observations would 

contain y 36 times and all other row, column, treatment and carry-over 
effects in such balance that they cancelled and find 



36y = 2031.8 




(45) 
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like Equ. (I9)s where the argument is more detailed, hecause in total all 
other effects halance out and disappear "by virtue of Equ* (9 ) and Equ. (44). 

Inc 1 dentally , 

y = ■ (^6) 

What Is more important is to gather up Equ, (^5) as the first line in 
Equ. (^ 8 ) together with other equations. In order to form an estlmabe 
of effect of Group I he would note that the sum of the observations 
comprises in the terms of Equ. (^5)j 

6)4 + 6 ai + (Bi + 02 + S 3 + 34 + Ss + gg) + (yi + Y 2 13 + t4 T5 + YS ) 

^ A A A 

+ (Sfij + 62 + 53 + S I4 is) 

= 6u + 6aj + 6]^ - 65 

= 317.0 . (1+T) 

In a similar way he might set up totals for all values of within 

Row of the Design, to produce lines 2 through 7 of Eqii. (48), Actually, the 
7th has to he replaced from Equ. (9 ) because If one were to treat the first 
Y lines as simultaneous equations one would find what is Galled a singularity , 
l.e., they would not solve, hut the matter can be resolved by this substitu- 
tion. This problem did not arise previously when all the equations ware simple, 
but now Carry-over is, as the word goes, confounded with row effects, in 
Equ, (48). Similarly, the Columns yield 6 more equations, inoludlng one from 
Equ. ( 9 ). Treatments yield 6 more. Carries-over yield 6 more although 
there the suhstltution is from Equ. (44). These are least squares equations. 
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y tt2 CX3 ag ag gj 0; 



^ A A <s ^ 



+36 

+6 

+6 

+6 

+6 

+6 



+6 



+6 



+6 



+b 



+6 



+1 +1 +1 +1 +1 +1 



+6 

+6 

+6 

+6 

+6 



+6 



+6 



+6 



+6 



+6 



+1 +1 +1 +1 +1 +1 



+0 

+6 

+6 

+6 

+6 



+6 



+6 



+6 



+6 



+6 



+1 +1 +1 +1 +1 +1 



+6 

+6 

+6 

+6 

+6 



+1 -1 

+1 -1 

+1 -1 

-1 +1 

-1 +1 



5l 


*^2 


A 

53 


A 

64 




A 

'Ss 


= 


Const . 














= 


2031.8 


+1 






-1 








317.0 




+1 






-1 






336.5 






+1 






-1 


= 


336.8 


-1 






+1 








370. T 




-1 






+1 






344.3 
















.0 














— 


333.0 
















336.1 














- 


329.8 
















353.3 














s 


342.1 
















.0 
















317.5 














=: 


340.3 
















306.5 
















364.0 
















334.5 














= 


.0 


+6 














308.6 




+6 










= 


340.9 






+6 








~ 


323.3 








+6 








355.3 










+6 






334.2 


+1 


+1 


+1 


+1 


+1 


+1 




.0 



,^48 



positions left empty contain zeroes 5 not shown) 



O 
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In a general way it is first necessary to test for the effect of Treat- 
ments when Carry-over is uninvolved in the models as was previonsly done in 
connection with Table XIX. Now, however, the matter will be approached from 
the point of view of the least squares equations. The basic model will be 
that of Equ. (43) but for the moment the elements of Treatment and Carry- 
over will be neglected. In a general way the columns (l4th through 25 th), 

Involving Y, and S of Equ, (48) and the corresponding rows must be 
iC ~ 

dropped. This is a matter of eliminating the control factors . In detail, 
the equations are: 



Cij 0.2 “3 0^4 ^5 ^3 .P5 Pb 



+36 

+6 

+6 

+6 

+6 

+S 

+6 

+6 

+6 

+6 

+6 



+6 



+6 



+1 +1 +1 +1 



+6 

+1 +1 



+6 



+6 



+6 



+6 



Sim 

2031.8 

317.0 



+6 

+1 +1 +1 +1 +1 +1 

(The positions left empty contain seroes. 



= 336.8 
^ 370.7 

= 3i^U.3 

= .0 

^ 333.0 

= 336.1 

- 329.8 

^ 353.3 

- 342.1 

= .0 

not shown ) 



The resultant estlniates are: 



ai 


a2 


as 


0^4 


»5 


“6 


- 3.61 


-.36 


-.31 


+ 5.34 


+ .94 


-2 . 02 


A 






A 


A 






02 


03 


04 


05 


06 


-,9h 


-.42 


-1.47 


+2.44 


+.58 


-.19 



It now is necessary to find the residual squares on estimates of 



( 49 ) 



( 50) 



Rows 
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1^3 

and Columns as control factors. This requires an operation similar to that 



of Equ. (28). This residual variability is; 

116,596.26 - 56 .^ 4 ( 2031 . 8) 

-{- 3 . 6 K 31 T. 0 ) -.36(336.5) -.31(336.8) +5.34(370.7) +.94(344.3) -2.02(326.5)} 
-{-.94(333.0) -.42(336.1) - 1 . 47 ( 329 . 8 ) + 2 . 44 ( 353 . 3 ) +. 58 ( 342 . 1 ) -. 19 ( 337 . 5 )} 

= 1590.38 ( 51 ). 

or if the thing be carried out with 10 -figure aocuracy, of the estimates, so 
that the results gibe with those of Table XECa, I585.7078 . In order to find 

the further reduction due to Treatments, from Equ, ( 48 ) the columns 
(20th through 25th) involving and the corresponding rows must be 

dropped. In detail, the equations are: 






^ A 



y ai 02 03 “4 ^5 «6 S2 S3 S4. S5 Ss Yl Yi Y 3 Y 4 Y 5 Ys 



Sum 



+36 - 2031.8 

+ 6+6 = 317.0 

+6 +6 = 336.5 

+6 +6 - 336.8 

+6 +6 - 370.7 

+6 +6 = 344.3 

+1 +1 +1 +1+1+1 s .0 

+6 +6 - 333.0 

+6 +6 = 336.1 

+6 +6 = 329.8 

+6 +6 = 353.3 

+6 +6 - 342.1 

+1 +1 +1 +1 +1 +1 = .0 

+6 +6 - 317.5 

+6 +6 - 340.3 

+6 +6 = 306.5 

+6 +6 - 364.0 

+6 +6 ~ 334.5 

+1 +1 +1 +1 +1 +1 = .0 

positions left empty contain zeroes, not shown) 



( 52 ) 



The resultant estimates for y , and 6^ ar 



j are as in Equ, ( 46 ) 



O 
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and ( 50 )* Those for ^hich remain as preTiously from Eq.u. ( 12 ) are 

shovn in Table XKb and ECIe. The residual var*labillty is: 

116,596.26 - 56.44(2031.8) 

-{-3.61(317.0) -.36(336.5) -.31(336.8) +5.34(370.7) +.94(344.3) - 2 . 02 ( 356 . 5 )} 
-{-.94(333.0) -.42(336.1) -1.47(329.8) + 2 . 44 ( 353 . 3 ) +.58(342.1) -.19(337.5)} 
-{-3. 52(317.5)+. 28 ( 340 . 3 ) -5.36(306.5) +5.06(369.0) +4.23(364.0) -.69(334.5)} 

1590.38 

-{-3. 52(317.5)+. 28 ( 340 . 3) -5.36(306.5) +5.06(369.0) + 4 . 23 ( 364 . 0 ) -. 69 ( 334 . 5 )} 
= 1079.48 (53) 

or If the thing be carried out ■with 10 -flgure accuracy, of the estimates, so 
that the results give with those of Table XK a, 1074 . 9356 . These results are 
summarized in Table XXIb- the value F falls significance. 

As a detail, in actual computer operation, both here and subsequently, 
the reduction in matrix, as from Equ. ( 48 ) to ( 5 S) is most easily and 
accurately accomplished by submitting the first I9 lines, or equations, as 
they are, replacing the 20 th through 25 th lines or equations by 6 ^ = 0 , 
for all ^ . If, for instance, each line is a punched card, the last 6 
cards have to be temporarily replaced. The last corresponding 6 columns 
automatically become Ineffectual. Thus in the present caBe, rather than 
Equ. (52), one might submit the equivalent. 



335 



* A. A A 



^ ^ t\ n 



A A A 



U ai a 2 ^3 Ct4 ag gg Bz 83 64 £5 85 Yl Y2 'V3 Y4 Ys Yg ^1 i?. ^3 64 65 = Const. 



+36 

+6 +6 
+6 4*6 

+ 6+6 
+6 +6 
+6 +6 
+1 +1 +1 +1 +1 +1 
+6 +6 
+6 +6 
+6 +6 
+6 +6 
+6 . +6 

+1 +1 +1 +1 +1 +1 

+6 

+6 +6 
+6 

+6 

+6 



+1 -1 

+1 -1 

+1 -1 
-1 +1 

-1 +1 



+6 



+6 



+6 



+1 +1 +1 +1 +1 +1 



+1 



+1 



+1 



+1 



+1 



+1 « 



2031.8 

317.0 

336.5 
336.8 

370.7 

.0 

333.0 

336.1 

329.8 

353.3 

3 ^ 2.1 

.0 

317.5 

3i*0.3 

306.5 

361;. 0 

334.5 

.0 

.0 

.0 

.0 

.0 

.0 

.0 



(The positions left empty conbaln zeroes, not shown) 
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It iSj secondl^f 5 necessary to test for the, effect of Treatments when 
Carry-over is involved, i.e., on the full model of Equ. (43). In order to do 
this we must find the estimates and residual variability when Treatment is not 
Iricluded and then when it is included. In a general way the columns (lUth 

A 

through 19th) Involving and corresponding rows of Equ. (48) must be 

dropped. We are making an analysis on the basis of estimating Carry-over 
as a control factor , like Rows and Columns, In detail, the eq^uations are. 



A A A 



\i ai 02 tt3 04 0(5 ag 0i 02 83 84, 85 ^3 ^4 ^5 S( 



Siam 



+36 



+6 +6 




+6 


+6 


+6 


+6 


+6 


+6 


+6 




+1 


HI 

+ 

H 

+ 

H 

+ 


+6 




+6 




+6 




+6 




+6 




+6 +1 


-1 


+6 


+1 


+6 


+1 


+6 -1 


+1 


+6 


-1 



+6 



+1 -1 

+1 -1 

+1 -1 
-1 +1 

-1 +1 



+6 



+6 



+6 



+6 

+6 

+1 +1 +1 +1 +1 +1 



+6 



-1 



+1 



+6 



+6 



+6 



+6 



+1 +1 +1 +1 +1 +1 = 

e positions left empty contain zeroes , not si 



2031.8 

31T.0 

336.5 
33S.8 

370.7 

344.3 

.0 

333.0 

336.1 

329.8 

353.3 

342.1 

.0 

308. 6 

340.9 

323.3 

355.3 

334.2 

.0 



(55) 



The resultant estimates are i 



ai 



«2 



»3 



0(4 



«5 



“e 



-2.71 -.65 +1.25 +4.44 +1.24 -3.57 



(56) 



which differ from those of Equ. (50) because the estimates of 5 , or 



o 

ERIC 






138 



remain as 



Carry-over, have "become involved "while the estimates of 3. 

J 

there "because Carry-over is uninvolved in Colxomn estimates. The estimates for 



6 or [£] are as shown in Ta"ble XXIc. It is now necessary to find the 



residual squares on estimates of y , Rows, Coltimns and Carry-over as conti’ol 
factors. This requires an operation similar to that of Equ. (28). The re- 



116,596.26 - 56.41+(2031.8) 

(-2.71(317.0) - .65(336.5)+ 1.25(336.8) +4, Uii(370. 7) + l-2i+(3^+4. 3) ■3.57(326.5)} 
(-.94(333.0) - .42(336.1) - 1.47(329.8) + 2.1*4(353.3) + .58(342.1) - .19(337.5)) 
(-3.82(308.6)'+ .$(340.9) - 3.36(323.3) + 1.59(355.3)' - 1.05(334.2) •+ 5.95(369.5)} 

- 1231.05 (Jrj.) 

or If the thing he carried out with higher accuracy, of the estimates, 

1233.5020. In order to find the further reduction due to Treatments it is 
necessary to consider their estimates which remain as previously from Equ. (12) 
and -hown In Table XZXh, since Treatments are confounded with neither Rows 
nor Carrles-over , In this Design, Accordingly one must make a further sub- 
traction, like that of Equ. (53 from the result of Equ. (5?)^ asi 

1231.05 

-{-3.52(317.5) +.28(340.3) -5.36(306.5) +5.06(369.0) + 4.23(364,0) -.69(334.5)} 

^ T20.15 (58) 

or if the thing he carried out with higher acc"uracy, of the estimates, 722.7298. 
These results are summarized in Table 3QCId» the value F fails significance, 
although It is a little greater than the F in Table XK— the antroduotion 
of Carry-over into the model is responsible for this. 
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The full model of Equ. (^8), together with the various reduced parts 
of those equations, as previously discussed will In actual practice he handled 
automatically 5 by the program, for electronic computer. In the Appendix. 

The pi'ccedure used in the present section of fitting models at 
successive levels of complexity, e.g., up to Carry-over and then with the 
addition of direct treatment effects is, as was remarked previously in 
connection with multiple latln squares , on the general principle familiar 
In fitting polynomials of Increasing complexity. There one may fit a 
parahola and then see if any suhstantlal improvement results if one goes on 
to the complexity of a cuhio. The only difference is that in the present 
work one adds necessarily a whole cluster of constants instead of a 
single constaTit.. 

The alternative analysis for algnificanoe of Carry-over will not 
usually he of practical importance; Carry-over is a means to an end, it 
is Just a control fac+or like Bows and Columns and it is surely 
of little interest to test their slgaificance. The results are shown in 
Table )QCIe. The first line comes directly from the second line of 
Table The second line directly from the second line of Table XXIb, 




I 
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Table XXI - ilnalvsis of latln square j^ith .conditioning. 



Period for direct Treatment and Car 2 ry-over 



a. Data colleoted, repeated from Table VI 



Week 



Group 


0 


1 


2 


3 


4 


5 


6 


SlUTl 


Mean 


I 


((D) 


( 1 ) 46.4 


( 3 ) 45.8 


( 2 ) 40.8 


( 5 ) 62.4 


(6)59.9 


( 4 ) 61.7 


317.0 


52.8 


II 


((2)) 


(2)60.9 


( 4 ) 59.2 


( 3 ) 44.9 


( 6 ) 64.2 


(1)55.3 


(5)52.0 


336.5 


56 , 1 


III 


(( 3 )) 


(3)50.0 


(5)50.0 


( 4 ) 64.2 


(1)60.9 


(2)58.4 


(6)53.3 


336.8 


56.1 


IV 


(( 4 )) 


( 4 ) 63.7 


(6)72.0 


( 5 ) 71.7 


(2)57.3 


(3)53.3 


(1)52.7 


370.7 


61.8 


V 


(( 5 )) 


( 5 ) 48.8 


(1)30.4 


(6)56.4 


(3)58.9 


( 4 ) 65.6 


( 2 ) 64.2 


3 ^ 1 4 . 3 


57.4 


VI . 


(( 6 )) 


(6)63.2 


(2)58.7 


(1)51.8 


( 4 ) 49.6 


( 5 ) 49.6 


(3)53.6 


326 . 5 


54.4 


Sum 




333.0 


336 . 1 


329.8 


353.3 


^ 342.1 


337 . 5 


2031.8 


56.4 


Mean 




55.5 


56,0 


55.0 


58.9 


57 . 0 


56.2 




Sujn,Sq^ 


18 , 795.14 


18,807.38 


19,661.07 










19,272.13 


20,936.87 


19,123.67 







b. Anal.y3l3 for direct Treabmeni alone (reproduced 
from Table XXc ) 



Factors 


d.f . 


Residual VarialDility 
( Squares ) 


A , . 

\i j Rows & Columns (control/ 
Control factors plus Treatment 


25 

20 I 

^ 


1585.7078 

1074.9356 

L ... 


(1585.7078 - 


1074 . 9356 )/ ( 25 - 20 ) _ , ist a 



5.20 



1074.9356/20 



o Direc-fa Treatment effects and Carry-O'ver effec-bs 





(1) 


(2) 


(3) 


J 4 )___ 


( 5 ) 


(D 


Contril) . 


-3.52 


+.28 


-5.36 


+4.23 


-.69 


+5.06 


Mean 


52.92 


56.72 


51.08 


60.67 


55.75 


61.50 




[1] 


[2] 


[3] 


14 ]__. 


[5] 


L 6 J 




-3.82 


+.69 


-3.36 


+1.59 


-1.05 


+5.95 
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d« Significance of direct Treatment effects 



i4o 



Faetors 



y , Rows, Coli;onns j Carries-over (control) 
Control factors plus Treataents 



d.f. 



20 

15 



Residual Variability 
(Squares ) 



1233.5020 

722.7298 



5,15 



_ (1233.5020 ■ 722. 7298 )/5 _ 

722.7298/15 



2.12 N.S. 



.e. Significance of Carry-bver effects 






Factors 


d.f. 


Residual Variability 
(Squares ) 


A 

M 5 , Rows, ColTanns, Treatments (control) 

i " 


20 


1074.9356 


Control factors plus Carries-"Oyer j 


15 1 


722.7298 




,15 



(107^.9356 - 722 . 7 g 96)/5 

722.7298715 



N.S. 



f. Estimation of direct Treatment and Carry-over in a simple 
way by neslectlnfi Row effect (reproduced iTom Table VIb ) 



Treatment 



After 


(1) 


( 2 ) 


( 3 ) 


( 4 ) 


( 5 ) 


( 6 ) 


] Sum 


Mean 


Contrib 


( 1 ) 


46.4 


58 ,. 4 


45.8 


49.6 


52.0 


56.4 


1 308.6 


51.4 


-5.0 


( 2 ) 


51.8 


60.9 


53.3 


59.2 


62.4 


53.3 


i 340.9 


56 . 8 


+ .4 


( 3 ) 


52.7 


4 o .8 


50.0 


65.6 


50.0 


64.2 


r 323.3 


53.9 


-2.5 


( 4 ) 


60,9 


64.2 


44.9 


63. T 


49.6 


72.0 


; 355.3 


59.2 


+ 2.8 


(5) 


50.4 


57.3 


53.6 


64.2 


48.8 


59.9 


334.2 


55.7 


- .7 


( 6 ) 


55.3 


58.7 


58.9 


61.7 


71. 7 


63,2 


369.5 


61 . 6 


+5.2 


Sum 


317-5 


340.3 


306.5 


364.0 


334.5 


369.0 


2031.8 






Mean 


52.9 


56.7 


51.1 


60.7 


55.8 


61.5 




56.4 




Contrib^ 


-3.5 


+ .3 


-5.3 


+ 4. 3 


-.6 


+5.1 











The residual ■variability divided by its degrees of freedom may be 
termed the mean residual sq.uare. Thus in Table XXIb ■ it is lOfU. 9356/20 
= 53.75 whereas in XXld it is 722.7298/15 = 48. l8. In either case it is 
related to the amount of inconsistency in the data— Inconsistency in the 
sense that the variability of the data can be explained by neither the 
control factors nor Treatment. The two values are fairly strictly com- 
parable. The smaller the value the better the model— if it were zero the 
model of control factors and Treat c;nts would be perfect. The concept is 
often useful in studying the results from an ex-neriment. There is a 
somewhat related idea of mean square for Treatment such as (1585. 7078 
- 1074.9356)/5 = 102.15, This is commonly found in the classic analysis 
of variance. It seems to be of little use and the root of much conceptual 
difficulty. It is the sort of thing best not thought about. 

In connection with Table 3QCI , when allowance is made for Carry-over, 
note that a quantity called mean residual variability, i.e., terminal 
residual (squares) variability, divided by the appropriate degrees of 
freedom, or the quantity that appears in the denominator of F , may be a 
good bit the less than when no such allowance Is made. The reduction is 
less than might have been expected but goes from 53.75 in Table XIX to 
48.18, i.e. , Is 10^ less. In much change-over material that comes to 
hand it turns out that much more of the variability that we should other- 
wise consider residual is, in fact. Carry-over. Insofar as this happens 
something that previously passed for extraneous or chance variation is. 

In fact, assigned to Carry-over. This affects the slgilflcance of the 

The effect of Treatments which was not previously 



Treatments, proper. 



signlficani; ■tlierL becomes significan’b. In a foKnal way^ 'the denomlnatioi’ 
of the F ratio is reduced and so the significance is increased. In a 
more real way, we Judge the treatment responses much more consistent 
and subject to far less vai'iability due to extraneous factors. In a 
general wsy, for many people, failure to allow in analysis of their 
experiments for Carry-o-ver must exaggerate the extraneous or chance 
variation and often lead them falsely to the conclusion that their experi- 
mental effects are not significant. 

The correlation, +.93, between Carry-over and direct Treatment effect 
in Table 3QCIc is eonsiderahie . In such cases one feels there must have been 
some real treatment effects, for how could they otherwise carry-over? 

Such evidence seems almost more convincing than the familiar test that 
the direct treatment effects contribute significantly to the reduction in 
residual variability. Incidentally, it may be noted that this value for the 
correlation was foimd previously in connection with Table VI between approx- 
imate Carries— over and Treatments. This approximate work la reported in 
Table XXI f. 

Table XXI is concluded by the simple estimation of direct treatment 
effects and Carry-over by neglecting row effect, as it was first done in 
Table VI. This may be a useful device foi* a man with limited calculating 
facilities. It will be noted that the treatment effects are exactly correct, 
by comparing Table XXIc and XXIb. This is as one would expect since 
in this Design they are, as previously, unconfoimded with Rows or Carriea- 
over. The Carries-over agree reasonably well with those gotten exactly 
in Table XXIc. Any discrepancy is due to the fact that in Table XXIb 

there Is no adjustment for row effects which do enter, as in Equ. (5Uj. 

O 
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In the present case the correlation between these rough estimates and 
exact estimates Is .97. Accordingly, It is possible to get a auic}r idea 
of whether there seems to be Carry-over present in data and the ill-provided 
man might direct his analysis on this basis. It may be of interest to note 
that the operation In Table XXlf is, in terms of the general Equ„ ( U8) 
equivalent to setting a. - 0 , for all i . This is essentially an analysis 
based on a model with Columns, Treatments and Carrles-over , but no allowance 
for Rows- — ^hus is it simplified. 

Carry-over is often of positive nature in the work used in this book 
for Illustration. SometimeE , however, under similar conditions it may be 
negative, or at least neutral. To illustrate this point there are shown the 
data of Table XXII on material similar to that of Table XXI . The Design is 
identical and hence the analysis, only the nature of the resultr- is different. 

The correlation between Carry-over and direct treatment effect, using 
their estimates as in Table XXIIc, is ,—.82 which is sizeable. It is a little 
difficult to Judge its signif Icance ; the 5% level for 6 independent vari- 
ables is -.81. The present estimates are not, of course, independent and 
it would be ai'duous to find the strict level of significance. As was 
argued previously, in connection with Table XXI , one must, however, feel 
there to have been some real treatment effects, insofar as they did carry- 
over. Such evidence seems, again, almost more convincing than the familiar 
test that the direct treatment effects contribute significantly to the 



reduction in residual variability. On the other hand, iLt must be admitted 
that the introduction of Carry-over to the model did not advantage the 
■ test of significance for Treatments proper. The value of P dropped from 
5.83 to 5 . 58 . Carrles-over, themselves , with an F of .83, were nowise 



igni f 1 c ant . 




Perhaps the wisest thing to say is that we should design our 
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Table XXII - Latin square 6 x 6 x 6 showing negative Carry-over 



a, 'Data collected 



Week 



Group 


0 




1 




2 




3 




4 




5 




6 


Bvm 


Mean 


I 


((D) 


( 1 ) 


51.6 


( 3 ) 


71.8 


( 2 ) 


55.9 


( 5 ) 


69.3 


( 6 ) 


59.6 


( 4 ) 


55.1 


363.3 


60.6 


II 


((2)) 


( 2 ) 


i+ 8.8 


( 4 ) 


51.4 


( 3 ) 


52.9 


( 6 ) 


56 . 6 


( 1 ) 


4 l .6 


( 5 ) 


54.6 


305.9 


51.0 


III 


(( 3 )) 


( 3 ) 


58.0 


( 5 ) 


58.6 


( 4 ) 


69.9 


( 1 ) 


45.4 


( 2 ) 


72.4 


( 6 ) 


65.8 


370.1 


61.7 


IV 


((U)) 


( 4 ) 


60.9 


( 6 ) 


45.4 


( 5 ) 


54.8 


( 2 ) 


49.6 


( 3 ) 


55.0 


( 1 ) 


42.7 


308.4 


51.4 


V 


(( 5 )) 


( 5 ) 


61.2 


( 1 ) 


41-3 


( 6 ) 


57.2 


( 3 ) 


59.4 


( 4 ) 


59.8 


( 2 ) 


56.4 


335.3 


55.9 


VI 


(( 6 )) 


( 6 ) 


61.2 


( 2 ) 


65 • 6 


( 1 ) 


54.8 


( 4 ) 


65 . 6 


( 5 ) 


62.0 


( 3 ) 


73.1 


382.3 


63.7 


Sum 




34 i.T 




334.1 




345.5 




345.9 


350.4 




347.7 


2065.3 




Mean 






57.0 




55.7 




57*6 




57.6 




58.4 




58.0 




57.4 




h. 


Analysis of Treatment effects ’Without 


allowanc e for 


Carry-^over 



(1) 


(2) 


131 




( 4 ) ( 5 ) 


(8) 


Contrib, 

Mean U 6,23 


+ .75 

58.12 


+4.33 

61.70 


+3.08 +2.71 
60.45 60.08 


+ .26 
57.63 


Factors 




d.f . 




Residual Variability 
( Squares ) 


y , Rows 8c Columns (control) 


25 




1620.87 




Control factors 8c Treatments 


20 




659.27 





F 

5,20 



(1620. 8t - 659 . 27 )/? . Qo»* 

659.27/20 ^ 




■ 1 
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c. Analysis of Treatment effects %r±th alloT^ance for Carry-over 



(Treatment estimates as in XXIIIc ) 





[1] 


/S A 

[2] [3] [4] 


[5] [6] 


Contrib . 


+3.64 


+.97 -1-79 -2.34 


+.93 -i.4o 



Factors 



_ _ I Residual Variability 
a. I - 1 / ^ 

; ( Squares } 



y 5 Rovs 3 Colxmons & Carries-over (control);' 20 * 14 t8.55 

■ I I 

Control factors & Treatments j 15 | 516 . 9 S 



p ^ ( i4t 6.55 - 5l6.98)/5 

5,15 ^ 516 . 98/15 



5.58w» 



Factors 

U 5 Rows, Columns & Treatments (control) 
Control factors & Carries-over 



! d.f . 



Residual Variability 
( Squares ) 



20 

15 



659-27 
516 . 98 



5,15 



(659.27 - 5i6.98)/5 

516 . 98/15 



,03 N.S, 



d* Data rearranged for simple Treatment and Carry-over analysis 



Treatment 



After 


( 1 ) 


( 2 ) 


(3) 


(4) 


(5) 


( 6 ) 


Mean 


Contrib • 


( 1 ) 


51.6 


72.4 


71.8 


65 . 6 


54.6 


57.2 


62.2 


+ 4.8 


( 2 ) 


54.8 


48.8 


55.0 


51.4 


69.3 


65.8 


57.5 


+ .1 


(3) 


42.7 


55.9 


58.0 


59.8 


58.6 


56.6 


55.3 


- 2.1 


(4) 


45.4 


56.4 


52.9 


60.9 


62.0 


45.4 


53.8 


- 3.6 


(5) 


4i.3 


49.6 


73.1 


69-9 


61.2 


59.6 


1 59.1 


+ 1.7 


(6) 


4l.6 


65.6 


59.4 


55.1 


54,8 


61.2 1 

1 


i 56.3 


- 1.1 


Mean 


46.2 


58.1 


6l.T 


60.4 


60.1 


57.6 


57.4 




Contrlb . 1 


1 -11.2 


+ .7 


+4. 3 


+ 3.0 


+2.1 


+ .2 
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experimen'fcs so thal; Carry-over, if 11: occur, 'will not lilas our calculalDion 
of ■treatment; effects . Secondly , we may want to eliminate it from the appar- 
ent variability of the participants. 

Table XXIId concludes the niamerlcal consideration ; it parallels 
Table XXI f , by neglecting row effects. This was first done In Table VI. 

It is a simple but rough way of estimating the effeots of direct Treatment 
and Carry-over. Treatment effeots are exactly correct, as previously In 
Table XXIf, while Carries-over agree reasonably well with those gotten 
exactly In Table XXIlc. 



Analysis with allowance for Carry-cver in latln squares without conditioning 
Period - The previous example of the data of Table VI is actually somewhat 
■unusual, in that there was a conditioning Period when materials or Treatment 
was tried but no result counts were made. This Period was included only to 
provide that a given Treatment, such as. (l), should be followed by itself 
as ■well as all other Treatments. Unfortunately, in practice, the condition-' 
Ing Period is often, indeed usually, omitted. Practical men are in such a 
hurry that they do not w’ant to spread their experiment over an extra Period. 
They want to get results, if possihle, from every Period Involved In the 
experiment. The loss is, however, not great and we can still make an analysis 
for Carry-cver. The situation Is illustrated by the data of Table XXIIIa, 
which is a condensation of those of Table 30C. 

For the first Column or Period of a Design, such as that of Table 
2QCI1I, it must be supposed that the model of Eq.u. (7) still obtains, i.e., 
there is no term for Carry-over. This is because any background Carry-over 
that may in uth exist is supposed uniform for all items in the first 



Column and hence completely confounded with the effect of the first Column, 
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At least that is the best view taken of the matter; the participants were 
all imder much the sams conditions beforehand so whateyer the 
carry-over is, in fact, it is the same for all Treatments. It is completely 
confounded with the general effect of the first Column and so for this Column 
we must simplify our model. Otherwise we proceed as previously for the latin 
square with a conditioning Period. Equ. (45) is the model obtaining. It 
does seem a rather strange situation when the model is not the same in all 
parts of the Design. 

The business of analysis again involves setting up least squares 
equations for the effects, y , a. , and 5^ appropriate for 

various levels of the models of Equ. (T) S'lid Equ. (43) and linding the 
variability variously residual. The handiest thing to do seems to be to 
set up the full equations, as in Equ, (48), previously^ and then cut 
back to the lesser situations by Judiciously dropping rows and columns. 
Examining Table XXIIIa, it is at once apparent that the grand total 848.2 
contains all effects of Rows, Columns, Treatments and Carries-over equally. 



so that we ma^' v^^rlte 
l6u “ 848.2 



(59) 



which is shown as the first line of the grand set of Equ. (66). When it 
comes to estimating the effect of Rows, it Is necessary to recognize that 
their totals must eontaln a carry-over effect. This may be done by detail- 



ing, as in Equ. (U?), the content of, say. Row I and then simplifying on 
account of the conditions of Equ. ( 9) and (44) or, once the knack is gotten 
of simply recognizing that the total, 221.6, for Row I lacks the Carry-over 
of Treatment (4), and of course contains y four times. Thus there may be 



written 
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4 y + 4 ai - 63 ^ 221.6 (60) 

whiela is "bhe second line of Equ. (66). Oihers may be wribben likewise 5 

as shown in the third and fourth lines* In the fifth line the corresponding 
statement is not made but rather there is an appeal to the condition of Equ- 
( 9 )* This is donSj again^ as in Equ, ( 48 ) to airoid the algebraic problem 

of singularity if Equ. (66) is treated as a set of simultaneous equations* 
This is to say we write 

^ A A * 

ai + ot 2 0 • ( 61 ) 



For* "the Columns, which, are confounded with nothing, the estimates remain 
fairly simple ; thus for Column 1 , 



4 y + J4S1 = 22 k . 2 



(62) 



which becomes a line of Eq.u, (66). Again the line for Column U must he 
replaced hy the condition 



6i + 02’^P3'^P4"’6 



(63) 



The situation for the Treatments is only Qompllcated, as may he seen in 
Table IQCIirb hy, say, Treatment (l) not containing Carry-over [l] so that 

4 y + 1+Yj - 61 = 208.0 ( 6 ^) 



which becomes the tenth line of Equ- (66). The usual kind of conditioning 
equation enters. The most intractable case 1 b Carry-*-over which is now eon— 
founded with hoth Row and Treatment. In particular, consider 6i . Plainly 



"1 



&Z 



Y2 



CX 2 



04 



T4 



«4 



T 3 



3 y = 57.2 + 54.0 H 



36 i + (ai + «2 + 0^4) (62 + 63 + 64) + (Y2 + Y3 + T4) + 3 y = 159.8 




3y - ttg - 01 




Yi + 36 x “ 159.8 

(65) 



48.6 



149 



as is shown in Ihe fourteenth line of Eq.u. (66). The whole situation Is 
as follows : 



A A A A « ^ ^ ^ 

ai az as ai+ $i S 2 S 3 S 4 Yi T 2 Y3 l4 ^2 ^3 



Const . 



+16 

+k +4 
+4 +4 

+4 

+1 +1 +1 +1 



+4 



+4 

+4 

+4 



+4 



+4 



+4 



= 848.2 
-1 ^ 221.6 
-1 « 21B.6 
^ 203.8 
= .0 
= 224.2 
= 209.6 
= 205.8 





+1 +1 


+ 1 +1 














.0 


+4 




+ j+ 






-1 








208.0 


+4 






+4 






^1 




= 


215.0 


+4 








+4 






-1 




206.8 






+1 


+1 


+1 +1 










.0 


+3 


-1 -1 


-1 






+3 






= 


159.8 


+3 


-1 -1 




-1 






+3 






161.6 


+3 -1 


-1 






-1 






+3 


- 


152.0 












+1 


+1 


+1 


+1 = 


.0 



(The positions left empty contain zeroes , not shown) 



( 66 ) 
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In a general way it is first necessary to test for the effect of Treat 
ments when Carry«over is uninvolved in the model# The basic equations 
are those of (66) but for the moment the elements of Treatment and Carry- 
over will be neglected* The colmms (lOth through lTth)5 involving 
and 6^ the corresponding rows must be dropped. The procedure is 

along the lines of setting up Equ. ( 49 ) from ( 48 )- This is a matter of 
eliminating the control factors. The estimates are: 

y = 53.01 ( 6 ?) 



ai Q2 ^3 ^4 

— — ( 68 ) 

+ 2,39 +1.6U -2,o6 -1.96 

Si S2 S3 S4 

. (69) 

+3.0U -.61 -1.56 =.86 

It now is necessary to find the residual squares on estimates of y 5 Rows 



and Columns as control factors. This requires an operation similar to that 
of Equ. (28), The procedure is along the lines of setting up Equ* ( 52 ) 
from ( 48 )* The residual variability is: 



h 5 ^ 133*&0 - 53 . 01 ( 848 * 2 ) 

-{ + 2.39(221.6) + 1.64(218,6) - 2.06(203.8) - 1.96(204.2)) 

-{ + 3 . 04 ( 224 . 2 ) - .61(209.6) - 1.56(205.8) - .86(208.6)) 

= 69.38 (TO) 

or if ■fcli0 ■thing he carried, ou.'t ■wi'th 10— figure accuracy ^ of "the es'fciin.a'tes j 
71.5025 as in Table XXIIIh. In order to find the further reduction due to 
Treatments it is necessary to consider their estimates ■which axe shown in 

Table XXIIIb. Since Treatments are unconfounded with either Rows or Colimms 

O 
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one need only make a further suhtraction from the result of Eq.u. (70) as 

69.38 



-{ 



1.01(208.0) + .TU(215.0) - 1.31(206.8) + 1. 59(218. h)} 

= UU.Ol ( 71 ) 



or if the thing be carried out with lO-figtire acc^irac^r, of the estimates 5 
so that the results give with those of TableXIXaj U 8 - 2550 - These results 
are summarised in Table XXIIIb; the value F fails significance. 

It is 3 secondly 5 necessary to test for the effect of Treatments when 
Carry-over is Involved* In order to do this we must find the estimates 
and residual variability when Treatment is not included and then when it is 
included. In a general way the columns (lOth through 13 th) involving y 
and corresponding rows of Eq.u. (66) must he dropped — although this 
does not affect the numerical solution in the present case. The procedure 
is along the lines of setting up Eq.u. ( 55 ) from (^8). We are making 
our anal^ysis on the basis of eliminating Carry-over as a control factor, 
like Rows and Columns. Then we get the estimates: 



A A A 

Oil “2 

+ 2 . 2 h + 1.29 -1.90 - 1.63 

^lEl] 62 [ 2 ] SsES] 

+.63 + 1.32 -.59 - 1.37 



(72) 



which differ from those of Equ. ( 68 ) because the estimates o'f 6 ^ , or Gamy- 

over 3 have become involved while the estimates of 0 , remain as there because 

J 

Carry-over is xmlnvolved In column estimates , The estimates for 6 ^ or 
[&] are as shown in Table XXIo. It is now necessary to find the residual 



squares on estimates of y , Rows, Columns and Carries-over as control factors. 
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This requires an operation similar to that of Equ, ( 2 S). The residual 
variahility is: - 
45,153.80 - 53 . 01 ( 848 . 2 ) 

-{+ 2 . 24 ( 221 . 6 ) + 1,29(216.6) - 1.90(203.8) - 1.63(204.2)} 

-{+ 3 . 04 ( 224 . 2 ) - ,61(209,6) - 1.56(205.8) - .86(208.6)3 
-{+.63(159.8) + 1.32(161.6) - .59(152.0) - 1.37(150.6)} 

- 61.15 ■ (73) 

or if the thing he carried out with higher accuracy, of the estimates, 
59 . 5000 . In order to find the further reduction due to Treatments it is 
necessary to consider their estimates which are different from those of 
Tabl^ JOailh because of their involvement with Carry-over in Equ. (66), 
they become as shown in Table XXIIIc. The row estimates are affected 
indirectly to become. 



Contrib. +2.10 +1.42 -1.99 -1.52 



( 74 ) 



The residual variability becomes 
45,153.80 - 53 . 01 ( 848 . 2 ) 

- {+ 2,10(221.6) + 1.42(218.6) - 1.99(203.8)- 1.52(204.2) } 

- {+ 3 . 04 ( 224 . 2 ) - .61(209.6) - 1.56(205.8) - .86(208.6)} 

- {+ .29(159.8) + 1.75(161.6) - 1.17(152.0)- .87(150.6) } 

- {- .94(208.0) + 1.18(215.0) - 1.60(206.8)+ 1.37(218.4) } 



= 30.84 



(75) 



it the contributions are calculated with more decinial places the result 
is 35 . 0740 , These results are summarised in Table JQCIIIc. The value of 



F falls significance even the more dismally with the introduction of 



Carry-over into the model. 
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As has heen said before ^ in practice one airoids the effort required to 
set up the foregoing equations ■usually by having an electronic computer 
set them up after it has been given the Design and the data. It then 
solves the equations and makes the test of significance. The equations 
are extensive enough to be so tedious that they can hardly be done by 
hand* 

The correlation between Carry-over and direct treatment affact from 
Table XXIIIc is obviously positive but Inconsiderable g in contrast to those 
gotten previously in connection with Table XXI - The affect of Treatment 
was 5 however 5 inconsiderable g as from the F test and hence could carry- 
over but little . 

In Table XKIIIe there is shown a rough analysis for Treatment and 
Carry-over analogous to that shown in Vlb for the more balanced case. In 
XKIIIe the Table is not quite complete for reasons as above and it is neces- 
sary to make some adjustments in calculating effects as is discussed in the 
final Chap, IK^ on improper flll^ where the detailed calculation of this 
table is shown in Table XLVII. The efficacy of this procedure should be 
considered. Firsts it will be noted that the Treatment effects are no 
longer exactly correct^ when compared with Table XXIIIc, This is as one 
would expect since in this Design they are to some degree confounded with 
Carry-over^ as in Equ. (64 and to a slight degree through Carry-over with 
block effects. The corresponding Carries -over agree even a little worse. 
Such discrepancy must arise ^ of course^ from the confounding with Treatments 
and Blocks of Equ. (64), Stilly it might be possible to get some idea of 
whether there seams to be Carry-over present on such a basis and the man^ 
with limited calculating facilities^ might direct his analysis on this basis, 
O 
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Table XXIII- Results reported ~by 4 Groups on 4 Treatments over 4 
a. Data collected 



Week 



Group 


1 


2 


3 


4 


Bum 


I 


(1) 56.8 


(2) 57.2 


(4) 54.6 


(3) 53.0 


221.6 


II 


(2) 57.8 


(3) 54.8 


( 1 ) 52.0 


(4) 54.0 


218.6 


III 


(3) 50.4 


' (4) 50.6 


(2) 50.6 


( 1 ) 52.2 


203.8 


IV 


(4) 59.2 


(1) 47.0 


(3) 48.6 


(2) 49.4 


204.2 


Sum 


224.2 


209.6 


205.8 


208.6 


848.2 


Sum sq.. 


12 , 611.88 


11,044.24 


10,607.48 , 


10 , 890.20 





b. Analysis for direct Treatment 


alone 




(1) (2) 


LSI 


(4) 


Contrib. -1,01 +.74 


-1.31 


+ 1.59 



Mn, 52.00 53.75 51.70 54.60 



Factors 


■ d.f . 


Residual Variability 
(Squares ) 


li , Rows & Columns (control) 


9 


. 71.5025 


Control factors plus Treatments 


6 


48.2550, 



™ _ (71.50'25 - 48.2550)/3 

. 3,6 " 48.2550/6 



.96 n.B,. 



o. Direct Treatment and Carry"OVer estimates from 



simultaneous equatlonB 

_dl dl iil- jj) 

Contrib. -.94 +I.I 8 -I .60 +1.37 

Mn, . 52.92 53.13 52.85 53.15 

[1] [g] ' [3]' rii 

+.29 +1.75 ^1.17 -.87 






Weeks 
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d. Test of slRn -^' canoe of treatment effects 
Factors 



M , Rows, Columis, Carries- over (control) 
Control factors plus Treatments 



d. f . 



Residual Variability 
(Squares ) 



59.5000 

35.0Ti^0 



3,3 



( 59.5000 - 35 . 074 o )/3 



^ .70 N.S. 



e. 



35 . 0740/3 

Data rearranged b y Treatment and Treatment of Precedlnfl Week 
Treatment 



After 


( 1 ) 


( 2 ) 


( 3 ) 


( 4 ) 


Sum 


Mn . 


Mn. 


Contrib , 


( 1 ) 




57.2 


48.6 


54.0 


159.8 


53.3 


53.0 


+ 1.0 


( 2 ) 


52.2 




54.8 


54.6 


161.6 


53.9 


54.3 


+ 2.3 


( 3 ) 


52.0 


49.4 




50.6 


152.0 


50.6 


50.1 


-1.9 


( 4 .) 


47.0 


50.6 


53.0 




150.6 


50.2 


50.6 


- 1.4 


Bk . gd . 


56.8 


57.8 


50.4 


59.2 


224.2 


56.0 






• 

Sum 


208.0 


215.0 


206.8 


218.4 


848.2 








Mn, 


52.0 


53.8 


51.7 


54.6 










Ad J . Mn , 


52.2 


54.3 


51.2 


54.2 










Contrlb , 


-.8 


+ 1.3 


- 1.8 


+ 1.2 
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In the actual conduct of the experiment Just considered one •would not, 
of course, -work with the data In the condensed form of Tahle XXIIl 
rather In the original form of Table XX , i.e., "with 20 Rows, The necessary 
equations are much the same but more numerous . ' The same program for an 
electronic computer may be used. The analysis is much the same except that 



•tie n'umber of degrees of freedom are greater than in Table XXI Ild. The 
test of significance of treatment effects becomes 



Factors 


d.f. ' 


Residual Variability 
( Squares ) 


A 

M 3 Rows, Columns 5 Carries— over (control) 


5k 


3585.5000 


Control factors plus Treatments ■ 


51 


3463.3700 



w - (3585.5000 - 3463. 3700 )/3 
3,51“ 3i+63.3T00/5l 



.60 N.S. 



Explicit solution for simple cases of Carry-over - There le a strong 
temptation for people with ability in handling equations to take the least 
squares equations of the style of Iqu, (^8) or (66) and ■write out explicit 
solutions for the estimates of direct treatment effects, Yt, » and Carry- 

.K 

over, 6^ , in terms of various sums of the observations. This is possible 
for cases 'when, t , the dimension is small. Such temptation should be, 
in general, resisted. It may, nonetheless, be Illuminating here to con- 
sider some of the smaller cases. 

The situation for the smallest of latln squares, 2x2x2, is of partic- 
ular practical importance and peculiar theoretical difficulty. It is 
discussed at some length in Chap. VIII, which is devoted to paired 



co^-narisons , i.e.. Designs with 2 Col'umns, of which this is a case. 

ERIC 



\ 

1 



158 



157 



The next smallest latln sg.uare, 3x3x3, has t odd and so, as in 
Chap. IV, is not recommended hecause the Carry-oTer is ill-hehaved. 
Paired latln squares ar*e recommended there. One ‘writes the satisfactory 
paired latln square Design, 2 (3x3x3) as follows: 




6 

ERIC 
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I 



Period 



Group 


1 


2 




3 


I 


(1) y 
^ 111 


(2) y 

1221 


(3) 


y 

1332 


II 


^212 


(3) 72232 


(1) 


^2313 


III 


(3) 73X3 


(1) 73213 


(2) 


^3321 


IV 


<1) ^411 


^4231 


(2) 


^4323 


V 


>'512 


^5212 


(3) 


^5331 


VI 


( 3 ) ^613 

1 


^6223 


(1) 


^6312 



It is possihle to solve for row, column, treatment and carry-over effects 
since there are 12 parameters: 



Groups 

Periods 



Treatments 2 
Carrles-Qver 2 



to be discovered from l8 observations. The situation is, indeed, over- 



determined with 6 degreeB of freedom, which are available for estimating 
the extraneous or re si dual variability. If the Design is repeated twice 
there would be 12 such degrees of freedom. For the Design, as it stands 
above, without a oondltionlng Period, one may set up the algebraic least 
squares equations involved, and then solve for the various kinds of effect 
explicitly in teimiB of sums of observations , but the results would be nigh 
Intolerable, 
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The previous example was the 2 (3x3x3) unconditioned. The conditioned 
Design, i.e., with a Period 0 where Treatment (l) preceded (l) in Period 1, 
Treatment (2) preceded (2) and Treatment (3) preceded (3), would he as 
follows : 



Period 



Group 


0 




1 




2 




3 


I 


((1)) 


(1) 


yiiii 


(2) 


yi22i 


(3) 


yi332 


II 


((2)) 


(2) 


y2122 


(3) 


y2232 


(1) 


y2313 


III 


((3)) 


(3) 


yai33 


(1) 


ysai 3 


(2) 


y3321 


IV 


((1)) 


(1) 


ym 1 1 


(3) 


y4231 


(2) 


y4323 


V 


((2)) 


(2) 


ysi22 


(1) 


y5212 


(3) 


75331 


VI 


((3)) 


(3) 


y6133 


(2) 


y6223 


(1) 


76312 



It is, again, possihle to solve for row, column, treatment and carry-over 
effects with 6 degrees of freedom, left over for the estimation of 
extraneous variahllity , The least squares equations, here, '’.re peculiarly 
simple and could he handled on a desk calculator. Even here, however, it 
Is most simple to use the electronic program as in the Appendix. 

For the UxUxU Design, 



Period 



Group 




1 




2 


I 


(1) 


yiii 


(2) 


71221 


II 


(2) 


7212 


(3) 


72232 


III 


(3) 


7313 


ik) 


73243 


IV 


(k) 


7414 


(1) 


74214 



3 

(^) yi342 

(1) y2313 

(2) y3324 

(3) y4331 



4 

(3) yi434 
(^) y2441 

(1) y3412 

(2) yit423 



it is similarly possihle to solve since there are 13 parameters to he 
discovered from l6 ohservations. For the Design with previous condition- 
ing Period, it is again possible to get y and direct treatment estimates 
from simple averages. Otherwise e3q)llclt algehraic solution is intolerahle. 
The least squares equations should he set up and solved, numerically, 
as previously. For all latin square Designs, t x t x t , 




t > 2 and 
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even^ the same can be said. If we attempt to write out explicit solutions 
for latin sq^uares, we shall encounter difficulty in defining sums of various 
kinds. 

Latin squares with missing Rows - Under the practical conditions of experi- 
mentation it is very common, indeed almost usual, for there oe some data 
missing from any latin square Design of any type. This is to say that the 
Design, as originally laid. out, is in some measure not completed. The misses 
may be conceived as of two types. First that with the odd cell or cells 
missed. This is the type usually discussed in the literature although it 
Is not often found in prei,ctice. Second that where a whole line or whole 
lines of Design is or are missing. This is very conanon in the actual execu- 
tion of es^eriments , although it does not seem to be discussed extensively 
in the literature. 

Let us consider common ways in which the problem of Designs Incomplete 
by Rows may ar*ise. Perhaps one has 15 patients on whom one wants to try 6 
Treaimients, It seems wilful and extravagant to lay out only two 6x6x6 latin 
squares when the remaining 3 men will give more litformation and one is com- 
pelled to add the first 3 Rows of a third latin square. The way things finally 
go may be imagined. We may plan to use a balanced Change-over 6x6x6, as in 
Table VTII, and use It 2,5 times over to produce a Design with 15 Rows and 
6 Columns, Since each line is associated with a man, and men tend to dis- 
appoint us, we may find ourselves with certain of the lines of the Design 
done 3 times, a number done twice, and one or two done once. Accordingly, it 
becomes a matter of dealing with a Design where balajice is much disturbed. 
Similarly, one may plan to test 7 Treatments on 7 Machines in 7 Periods. One 
of the Machines assigned is, however, withdrawn Just after the experiment 
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starts andno replacement is possible. No'm' it is idle to tell an engineer 
interested in the Treatments on the Machines that since Treatments are no 
longer orthogonal to Periods the work must he abandoned. He will reply 
that he can get about 6/7 of the information anyhow and proceed to get 
it. The biometrician must do the best he can with the incomplete Design. 

By way of illustrating the loss of Rows of the Design, a far more 
modest example is given in Table }QCI7j where the last Row of Table VI 
has been deliberately lost. There Is no great problem. One simply 
applies the appropriate least squares equations , which are prohahly on 

an electronic computer, as in the program of the Appendix. The procedure 
of setting up the equations may, however, sometimes be of practical use 
and certainly Is of interest in justifying the program alluded to. In 
Table 3DCIVa there is shown this reduced Design and resultant data. There 
has been added to each cell the Carry-over, as well as the usual Treatment 
and result. This has been done because it is a little difficult to find 
one *s way about such a disturbed situation. 

Examining Table XXTVa^ it is at once apparent that the grand total I 66 I.I 
contains all effects of Rows, Columns and Treatments equal]^, so niiat In view 
of Equ. ( 9 ) they may be Ignored, The grand total does not, however, contain 
the Carries-over equally^ [2], [3], [5] and [6] occur each five times 
whereas [l] occurs six times and [4] occurs four times. More economically 
we may say, in view of Equ. (44), that [l] occurs once too often and [4] 
once too infrequently so that we may write 

A A A 

30p + 61 - 64 = 1661.1 , { 16 ) 



which is shown as the first line of the grand set of Equ. (81). When it 



comes 

O 




to estimating the 



effect of Rows, it is necessary to recognize that 
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each of their totals must contain a carry-over effect, as previously in 
Equ. (U8); this effect is not due to the line of the Design "being missing. 
Thus, again, we may recognize that the total, 317«0, for Row I, contains 
the Carry-over of Treatment (l) once too often hut lacks that of (4), and 
of course contains y six times. Thus there may he written 

6y + 6ai + - 6g « 31T.0 (7?) 

which is the second line of Equ. (8l). Others may he witten likewise, as 
shown in the third through sixth lines. In the seventh line- the correspond- 
ing statement Is not made hut rather there is an appeal to the condition 
of Equ. (9). This is done, again, as In Equ. (48) to avoid the algehraic 
prohlem of singularity. Even the Columns, now, are confounded with the 
effect of Treatments and Carrles-over . Thus Column 1 lacks Treatment (4) 
and Carry-over [4] so that we must say 

A A A A 

5y + 501 - Y 4 - 64 - 269.3 (78) 

which becomes a line of Equ. ( 81 ). Again the line for Column 6 must he 
replaaed by the condition 

@1 + @2 + • • • + 06 - 0 . (79) 

The situation for the Treatments Is complicated hy, say, the total for 
Treatment (l) not containing Column 6 nor Carry-over [ 3 ] so that 

5u - 06 + 5 yi - ^3 - 264.8 (80) 

which hecomes the fourteenth line of Equ. (8l). The usual kind of condi- 
tioning equation enters. The most intractable situation exists for Carry- 
over which has hoen variously disturhed hy the missing Row of the Design. 
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Thus, as in the twentieth line of Equ. (8l)j all six possible values of 

A 

are present and the appropriate line of those equations is very slniple. 
At the other extreme only four of the possible values of 64 are present 
and It is heavily confounded with every other type of effect. The whole 
situation is as follows: 



+30 

+6 +6 
+6 +6 

+6 
+6 

+1 
+5 
+5 

+5 
+5 

+5 

+5 
+5 
+5 
+5 

+5 



+6 



+6 



+6 +1 

+5 

+5 

+4 -1 



+5 



+1 -1 

+1 

-1 +1 



ot 2 


•A A A 

61 $2 63 


04 05 06 Yl Y 2 Y 3 Y4 Y 5 


Ye &2 53 ^4 


A A 

65 5 6 = Slim 








+1 -1 


= 1661.1 








+1 -1 


= 317.0 








+1 


“1 = 336.5 








+1 


-1 = 336.8 








-1 


+1 = 344.3 


+1 








= .0 




+5 


-1 


-1 


= 269.3 




+5 




-1 -1 


= 264.1 




+5 


-1 




-1 = 258.1 






+5 -1 




-1 = 296.0 






+5 -1 


-1 


= 288.8 




+1 +1 


+1 +1 +1 




= .0/- 






-1 +5 


-1 


^ 264.8 






-1 +5 




-1 ^ 283.0 






-1 +5 


-1 


= 253.2 




-1 


+5 


-1 


= 300.3 




-1 


+5 




-1 ^ 262.8 






+1 +-1 +1 +1 +1 


+1 


= .0 








+6 


- 308.6 






-1 -1 


+5 


- 287.6 


-1 




-1 -1 


+5 


= 270.6 




-1 -1 


** 4 _ 


-1 +4 


= 219.6 






-1 -1 




+5 ^ 276.9 








+1 +1 +1 +1 


+1 +1 = .0 



(81) 



(The positions left empty contain zeroes , not 
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Let us first make the analysis for treatment effects, without allowance 
for Carry-over, towards the results of Table XXIVb. The basic equations are 
Equ. (8l), but for the moment the elements of Treatment and. Carry-over will 

A 

bo neglected. The columns (l4 through 25) involving y, and 6. and the 

corresponding rows must be dropped. The procediire Is, again, along the lines 
of setting up Equ. (49) from (48). This is a matter of eliminating the 
control factors,. The estimates are: 



30y = 1661.1 

y = 55.37 

and, for the moment. 







«3 


«4 




- 2.54 


+ .71 


+ .76 


+ 2.01 -.95 




01 


02 


S3 


04 05 


06 


-1.51 


-2.55 


-3.75 


+3.83 + 2.39 


+1.59 



(82) 

(83) 

(84) 



It now is necessary to find the reBldual squares on estimates of y , Rows 
and Columns as control factors. This residual variahllity is: 

93 , 312.21 - 55.37(1661.1) 

- {-2.54(317.0) + .71(336.5) + .76(336.8) + 2.01(344.3) - .95(326.5)} 

- {-1.51(269.3) - 2 . 55 ( 264 . 1 ) - 3.75(258.1) + 3.83(296.0) + 2.39(288.8) 

+ 1.59(284.8)} 

= 1036.76 (85 ) 



or If the thing he carried out with more decimal places In the estimates , 
1033.19 as in Table XXIVb. In order to find the further reduction due to 
Treatments it is necessary to consider those estimates. The estimate of 
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y remains as in Eq.u. (8S ) “because the total contains all Treatments equally, 

A 

like everything else. The estimates of remain as in Equ. (83). The 

estimates for the Columns are, however, changed since they now contain 
various sets of Treatments. In a general way, one simply ignores the 
20 th to 27th columns and corresponding rows of Equ. (8I). Thus for the 
first Column of the Design, 

5p + 531 - Y4 = 269.3 (86) 



and one gets the estimates 

A JS A A A 

3l 02 03 04 05 06 

-.60 -1.82 - 4.49 + 4.25 +1.50 + 1.15 



( 87 ) 



From the same reduced matrix, the equation for Treatment (l) is 

5y - 06 + 5 yi = 264.8 (88) 

and thus one gets the estimates for Treatment as in Table XXlVh. Then the 
residual varlahility is 

93,312.21 - 55.37(1661.1) 

-{ - 2.54(317.0) + .71(336.5) + .76(336.8) + 2.01(344.3) - .95(326.5)} 

-{ - .60(269.3) - 1 . 82 ( 264 . 1 ) - 4.49(258.1) + 4.25(296.0) + 1.50(288.8) 

+ 1.15(284.8)} 

-{ - 2 . 18 ( 264 . 8 ) + 2.08(283.0) - 4.43(253.2) + 4.57(300.3) - 3.71(262.8) 

+ 3.67(297.0)} 

* 670.85 (89) 

or If the thing be carried out with more decimal places on the estimates , 
664.37 as in Table XXiVb, 
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It is, secondly, necessary to test for the effect of Treatments when 
Carry-over is Involved. In order to do this we must find the estimates 
and residual variaMllty when Treatment is not Included and then when it 

A 

is Included, In a general way the columns (ll+ through 19) Involving y 

k 

and corresponding rows of Equ. (8l) must he dropped. The estimate for \s 
is no longer as in Equ. (82) hecause, as can he seen In Equ. (8l), there 
is confounding with 6 . How 

X/ 

M ^ 55. ia 



other estimates hecome 





ai 


^2 


«3 


0^4 


“5 




-2.38 


+ .20 


+1.74 


-2.45 


-2.01 


01 


02 


03 


A 

04 


05 


06 


-2.03 


-3.07 


-2.93 


+3.85 


+2.98 


+1.19 




62 


^3 


64 


«5 


fie 


-3.58 


+3.16 


-1.80 


-2.38 


+ .29 


+4.32 



The residual var lability is still quite simple as 



(91) 



93,312.21 - 55.^1(1861.1) 

- { - 2.38(317.0) + .20(336.5) + . 

- ( - 2.03(269.3) - 3.07(264.1) - 

- { - 3.58(308.6) + 3.16(287.6) - 



2.01(326.5)} 

1.19(284.8)} 

4.32(297.8)} 



= 797.98 



(92) 



or If the thing he carried out with more decimal places In the estimates. 



the 797.76 as in Tahle XXlTc. In order to find the further reduction due to 



Treatments it is necessary to solve the full set of Equ. (8I) and get 
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( 93 ) 



y = 55.50 





A 

«i 


«2 


A 


A 


A 




- 2.01 


+ .40 


+1.65 


+2.06 


- 2.11 


A 




A. 




A 


A 


61 


82 


83 


64 


65 


@6 


70 


-1.92 


-3,. 80 


+4.29 


+1.81 


+ .32 



^ together with the estimates of or (k) and 5^ or [£] of Table XXIVc. 

The residual variability becomes 



93 , 312.21 - 55.50(1661.1) 

- { - 2.01(317.0) + .40(336.5) + 

- { - .70(269.3) - 1.92(264.1) - 

- { - 3 . 01 ( 264 . 8 ) + 2.12(283.0) - 

- { - 3 . 74 ( 308 . 6 ) +1.88(287.6) - 

= 495.80 



. - 2.11(326,5)} 

. + .32(284.8)} 

. + 3.56(297.0)} 
. + 3.45(297.8)} 

(94) 



if the thing be carried, out wi^:h itiore deciiiial places in the estiniates 
the 489.73 of Table XXiVc. 



As has been said before, in practice one avoids the effort required to 
set up the foregoing equations usually by having an electronic computer 
do so, after it has been given the Design and the data, in the electronic 
program of the Appendix. That then solves the equations and makes the test 
of algnifleance. The equations are extensive enough to be so tedious that they 
can hardly be done by hand. The confounding is horrific. 

In Table 3QCIVb there is shown below the contributions for Treabments 



the Adjusted Mean--not the Mean as previously. The new quantity is found 

A 

by adding to y , It is essentially an estimate of what mean effect 



of Treatment would have been if some sort of confounding had not 




lies 



occurred. 
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c. Ana?.ysis for direct Treatment, with allovanee for Carry-over 



A ^ yS • ^ ^ 





( 1 ) 


(2) 


I 3 ) 


( 4 ) 


( 5 ) 


( 6 ) 


Contrib 


- 3.01 


+ 2.12 


- 4.12 


+4.47 


-3.01 


+3.56 


Adj. Mn. 


52.49 


57.62 


51.38 


59.97 


52.49 


59.06 




3 - 


[ 2 ] 


[3] 


[ 4 ] 


_ 15 ] 


[ 6 ] 




-3.74 


+1 • 88 


-2 . 67 


+ .25 


+ .83 


+3.45 



Factors 


d.f . 


Residual Variability 
( Squares ) 


IJ 5 Rows, ColTjmns & Carrles-over (control) 


15 


797.76 


Control factors plus Treatments 


1 

10 ; 


489.73 



F 



5,10 



( 797-76 - U 89 .T 3)/5 

499.73/10 



1.26 N.S. 



d. Data arranged Tay Treatment and by Treatment of the preceding Week 



Treatment 



After 


( 1 ) 


( 2 ) 


( 3 ) 


( 4 ) 


( 5 ) 


( 6 ) 


Sum 


Mean 


Contr ^ 


( 1 ) 


46.4 


58.4 


45.8 


49.6 


52.0 


56.4 


308.6 


51.4 


- 4.2 


( 2 ) 


51.8 


60.9 




59.2 


62.4 


53.3 


237.6 


56.6 


+ 1.0 


( 3 ) 




40.8 


50.0 


65 . 6 


50.0 


64.2 


270.6 


53.5 


- 2.1 


( 4 ) 


60.9 


64.2 


44.9 




49.6 




219.6 


57.1 


+ 1.5 


( 5 ) 


50.4 




53.6 


64.2 


48.8 


59.9 


276.9 


55.6 


.0 


( 6 ) 


55.3 


58.7 


58.9 


61.7 




63.2 1 

i 


297.8 


59.1 


+3.5 


Sum 


264.8 


283.0 


253.2 


300.3 


262.8 


1 

297.0 1 


1661.1 






Mean ! 


53.96 


56 , 60 


50.64 


60 . 06 


52.56 


59.40 1 








Adj.Mn. i 


52.5 


56.6 


50.8 


60.4 


53.3 


59.7 1 








Contr , ! 


- 3.1 


+ 1.0 


- 4.8 


+ 4.8 


-2.3 


+ 4.1 i 




55.6 






i69 



In the present case it argues as to the mean effect of Treatment, if that 
had occurred equally in all Columns. There is a similar Adjusted Mean 
in Table /Kiyc which is essentially an estimate of what mean effect of 
Treatment would have been if each had occurred equally in all Columns and 
with the same Carry«over, 

It may be of interest to compare the estimates of Table XXIVc with those 
gotten on the full data as in Table XXI a and b. Perhaps one may say that the 
estimates for Treatment and Carry-over are substantially the same but the 
value of F drops from 2.12 to 1.26 and this with decreased degrees of 
freedom, which makes things worse. 

In Table XX'nd there is again shown a rou#i analysis for Treatment and 
Carry-over analogous to that shown in Vlb for the more balanced case. This 
table is, of course, far' from complete and it is necessary to make some 
adjustments In calculating effects as is discussed in the final Chap. IX, 
on improper fill. 

In Table 3QCIV the number of degrees of freedom consumed, by estimates of 
the Rows is/ of course, less than that in the full Design. The number left 
after the control and experimental factors have been handled is the number 
ascribed to the residual ■vmrlability. This mmtoer is also reduced frcm that 
for the full Design, 

The problem of breaking up variability among Treatment effects may 
arise in a situation where there are missing data. A slightly approximate 
but satisfactory procedure is that previously discussed at length in 
connection with single, complete latin squares. It may be Illustrated 
on "che case of Table 3DCIVb, where a Row is missing., Ilie value of K 
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would be difficult to calculate exactly. Accordingly^ the empirical value 
has to be calculated in all earnestnesB, along the lines of Equ. (36) as 



„ 1033.19 - 664.37 ^ 

^ “ (- 2.18)^ +(+2.08)^ + (- 4.43)^ + (+ 4.57)^ + (- 3.71)^ +(+3.67)^ 

« 4.801 . (95) 

To cover again seme of the ground of the earlier and more complete example, 
consider: 

a. The coBiparlson of TreatiEents (l) and (3) .1th all other Treatments as 
shown in Equ, (3l) and (37)- There must be calculated 

4 0Qi( (- g.l8 - 4.43)^ ^ (+ 2.08 + 3.71 +-3.67)^_ y 

- 157.3239 . ( 96 ) 

Now this value is to be compared with the final residual variability of 
Table XXIVb to give 



^ 157.3239 

1,15 664.37/15 



3.55 



(97) . 



which on reference to Table L is no longer significant at the 5?^ level, 
b. The comparison of (2) and (3) with (4), (5) and (6), as shown in Equ. 



( 33 ) and ( 39 ). Now there must he calculated 

4 5qi{ (t 2.08 - 4 . 43)2 (+ 4.57 - 3.71 + 3.679i 

_ (+ 2.08 - 4.43 + 4.57 - 3.71 + 3 . 67 ) y 



= 41.5339 



( 98 ) 







i. 




Nov this value Is to he compared with the final residual varlahility of 
Table XXIVb, to give 



ITl 



F 




(99) 



■which, on refereiice to Table L proves not significant. Since in the 
present case, each Treatment is represented the same nimber (five) 
times the tests of significance in connection with Iqu. (9?) and (99) 



are exact. If, in fact, the various Treatments had had various numbers of 
observations (s,s can happen) the test of significance of the F , with a 
single degree of freedom in the numerator, would be disturbed. 

Latin squares with missing cells - Let us, secondly, consider the situation, 
more trivial but so dear to the literature, where a Lesign is incomplete by 
occasional values or cells. This situation may arise in various ways, per- 
haps one machine of a series breaks down after supplying 2 or 5 observations; 
some man falls, in part, to complete his assignment of Changes -over, ilils 
situation is illustrated by the deliberate loss of data from Table VI, a single 
latln square; this compact Design is convenient for ■ our piarpose. Two cells 
were dropped from Table VI to produce Table 3DCV, Against each observatidn 
there is shown, as previously in Table XXXV, not only the Treatment 
proper but the Carry-over. In the case of the two missing observations 
(nr) it is supposed they were administered and that there Is Ca^ry-over 
In the following observation. In practice, there is often a missed 
administration of Treatment besides no obaervatlon, so that there Is no 
Carry-over. This alternative can be easily enough picked up In the 
appropriate least squares equations. The prooediare of analysis is Just 
as for the previous case with a missing Row, It will be summarized a 
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.-le more briefly, mainly by giving the equations in matrix form. 




iLT\. 'V£3' 'VO VO' 'VO Lf\ VO VD lLr\, VO 'VO' 'VO' 'if\ lf\ 



It is perhaps test, ^galn, to set up the total least squares equations 
for Table XXV , just as Equ. (48) was set up for Table XXI . Many of the 



rows will be Indeed repeated. The grand total lacks the Bows, Columns, 
Treatments and Carrles-over properly involved in the missing (N.R.) cells 
and this shows up in the first line of Equ. (lOO). On the other hand, the 

^ A 

second line for ai is exactly as in Equ. (48). The third line for 02 i- 
disturbed by the missing cell. Similarly the lines for some of the ‘ 

Columns of the Design are disturbed as are those for some of the Treatments 
ar i Carrles-over. The whole situation is as follows: 



U a-i aa 03 ot4 05 og @1 62 S3 S4 @5 H Yl Ya Y 3 Y4 Ys Ys ^ 1 &2 *54 *55 



Sura 



34 -1 

6 +6 

+5 



-1 -1 

-1 



+6 



+6 



+6 

+1 +1 +1 +1 +1 +1 



+6 



-1 



+5 



+6 



+6 



■1 +5 

+1 +1 +1 +1 +1 +1 



+6 



+6 



+6 



-1 



-1 



6 +1 -1 

5 -1 -1 

6 +1 -1 

5 -1 +1 -1 

6 -1 +1 



-1 



-1 


-1 




-1 


-1 


- 


1923.0 






+1 




-1 


= 


317.0 


-1 








-1 




277.3 








+1 


-1 




336.8 






-1 




+1 


= 


370.7 








-1 


+1 




344.3 














.0 














333.0 


-1 






-1 






276.9 












“ 


329.8 












“ 


353.3 




-1 






-1 


- 


292.5 












= 


.0 














317.5 












ZI 


3 UO .3 












= 


306.5 


+5 






-1 




= 


304.8 




+5 






-1 




284.9 


+1 


+1 +1 








= 


.0 






+6 








308.6 


-1 






+5 




= 


281.7 








+6 




- 


323.3 




-1 






+5 


= 


305.7 










+6 




33^+. 2 






+1 


+1 +1 


+1 +1 +1 




.0 



h 



(The positions left empty contain zeroes, not shown) 
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First there must be considered the model with only the control factors 
i , Rows and Columns. The elements of Treatment and Carry-over will be 

A 

neglected, l.e.. the colvmms (lltth through 25tl0 Involving \ 

Equ. (100) and the corresponding rows must be dropped. The resultant 
estimates are: 

w = 56.51 



A 




* 






— 


“1 


0-2 


0^3 




“5 


ag 


-3.68 


-1.33 


-.38 


+5.27 


+ .87 


-.76 


61 


02 


03 


04 


05 


06 


-1.01 


-1.4o 


-1.54 


+2 . 37 


^1.84 


-.26 



It now is necessary to find the residual squares on estimates of u , Rows 
and Column n as control factors , which is : 



110,631.46 - 56.51(1923.0) 

- { - 3.68(317.0) - 1.33(277.3) - ... - .76(276.9)} 

- { - 1.01(333.0) - 1.40(276.9) - ... - .26(337-5)} 

-1523.52 ■ (102) 

if the thing be carried out with 4-figure accuracy, of the estimates. In 
order to find the further reduction due to Treatments it Is necessary to 
consider Equ. (lOO) less the 20th through 25th columns and the corresponding 
rows. The resultant estimates are; 
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y = ^ 6,68 



/K A rt A 



ax 


“2 


“3 


a 4 


05 


ae 


- 3.85 


-.53 


-.55 


+5.10 


+.70 


-.86 


A 

61 


62 


A A 

03 04 


A 

05 


06 


-1.18 


- ^ 60 


-1.72 


+2.20 


+1.74 


-.43 



(103) 



and estimates of Yi, (^) » shown in Table XXVb. The residual is 

A 



110 , 631.46 - 56.68(1923.0) 

- { - 3 . 85 ( 317 . 0 ) = .53(277.3) - ... - ,86(276.9)} 

- { - 1.18(333.0) - .60(276.9) - ... - .43(337.5)} 

- { - 3.77(317.5) + . 03 ( 340 . 3 ) - ... + 4.82(369.0)} 

* 1034.7991 ( 104 ) 



if the thing be carried out with 4-figure accuracy, of the estimates. 

These results are suinmarized in Table XXVb^ ‘ the value F fails significance, 
as it did in the full, original table of data. 



Next there must be considered the model with only the control factors 
y , Rows, Col\iinns and Carrles-over . The columns (l4th through 19th) involving 
and corresponding rows of Equ. (lOO)must be dropped. The resultant 
estimates are : 
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A 


y 

^2 


= 56 . 

^3 


57 

A 

04 


“5 


“6 


- 2.49 


- 1.69 


+1.01 


+ 3.98 


+ .98 


- 1.79 


A 

61 


A 

02 


S 3 


A 

64 


05 


A 

Se 


-1.07 


-1.59 


- 1.60 


+2.32 


+ 2.25 


-.32 


irHIl 

< 


A 

^2 


A 

^3 


A 

64 


65 


06 


-4.05 


-.35 


- 3.15 


+ 3.37 


-li3l 


+5 . 48 



(105) 



i. . A 
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It now is necessary to find the residual squares on estimates of y , Rows 
Columns and Carries-over as control factors, ■which is: 



110 , 631.^+6 - 56.57(1923.0) 

- { - 2. h9 (317.0) - 1.69(277.3) + . 

- { - 1.07(333.0) -1.59(276.9) - .. 

- { - 1+. 05(308. 6) - .35(281.7) - .. 

= 1155.2864 



. - 1.79(276.9)} 
- .32(337.5)} 
+5.48(369.5)} 



( 106 ) 

If the thing he carried out ■with 4-figure accuracy, of the estimates. In 
order to find the further reduction due to Treatments it is necessary to 
consider the full model, with all factors, of Equ. (lOO). The resultant 



estliiiates are: 


QL2 


y ^ 56.78 

a 3 a4 


“5 


^6 




-2.67 


-.95 


+.78 +3.73 


+ .90 


-1.80 




Bl 


02 


03 04 


is 


®6 




-1.28 


-.72 


-1.81 +2.11 


+2.23 


-•53 j 




and estimates of 


(or (k) ) and 


(or 


ih) B 


IB shown 


The residual is 












110,631.46 - 56.78(1923. 


0 ) 








- { - 2.67(317.0) - 


.95(277.3) + 


. . . - 1 


.80(276.9)} 


- { - 1.28(333.0) - 


.72(276.9) - 


■ • • ^ « 


53(337. 


5)} 


- { - 3.86(317.5) - 


.06(340.3) - 


. . . +4. 


72(369. 


0)} 


- { - 4.28(308.6) + 


.38(281.7) - 


. . . + 5 


.24(369 


.5)} 



( 107 ) 



=666.1826 



(108) 
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c. Analysis fo r direct Tfea'bnien'b , vl'th, allowance for Car2‘‘y— ovar 



Cl) 


(2) 


(3) 


(4) 


(5) 


( 6 ) 


Con-fcr. “3.86 

Adj. Mn, 52.92 


-.06 

56.72 


-5.69 

51.09 


+3.93 

60.71 


+ .96 

57.74 


^ * 

+4.72 
,61 . 50 


A 

_[1] 


A 

[2] 


[2] 


A 

[4] 


rii 


[6] 


-4.28 


+ .38 


-3.32 


+3 . 36 


-1.39 


+5.24 



Fac^bors 


f 

d. f . 


Residual FarialDility 


— 




( Squares ) 


y , Hows 5 Columns & C;arries-over (control) 


18 


1155.29 


Control factors plus 'I'reatnients 


13 


666.18 



F 



5,13 



(1155.29 - 666.ie)/5 
666 . 18 / 13 ^ 



1.91 F.S. 




Trealment 



After 


(1) 


(2) 


-^(3) 


(4) 


(5) 


(6) 


Bum 


Adj. 

Mean 


Cont;r , 


(1) 


46.4 


58.4 


45.8 


49.6 


52.0 


56.4 


308 . 6 


51.4 


-5.5 


(2) 


51.8 


60.9 


53.3 




62.4 


53.3 


281.7 


57.2 


+.3 


( 3 ) 


52.7 


40.8 


50.0 


65.6 


50.0 


64.2 


323.3 


53.9 


-3.0 


(4) 


60.9 


64.2 


. 44.9 


63.7 




72.0 


305.7 


61.4 


+4 . 5 


(5) 


50.4 


57. 3 


53.6 


64.2 


48.8 


59.9 


334.2 


55.7 


-1.2 


(6) 


55.3 


58.7 


58.9 


61.7 


71. T 


63.2 


369.5 


61.6 


+ 4.7 


Sum 


317.5 


340.3 


306.5 


304.8 


284.9 


369.0 


1923 . 0 






AdJ .Mn. 


52.9 


56.7 


51.1 


61.0 


57.9 


61.5 








Contr . 


-4.0 


-.2 


-5.8 


+4.1 


+1.0 


+4.6 , 




56.9 
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If the thing be carried out with it-figure accuracy, of the estimates. These 
results are suinmarized in Table XXV cj the value F fails significance, 
as it did In the full, original table of data. 

Unfortunately, one cannot, as for previous problei.is , in practice avoid 
the effort required to set up the foregoing equations by having an electronic 
computer do so, after it has been given the Design and the data, in the 
electronic program of the Appendix. The problem is discusBed there. Briefly, 
the prograjii would have to be extended. 

In the situation of missing cells rather than Rows, the procedure 
of breaking variability up Is exactly as formerly. Again, in the test, 
there tends to be a slight exaggeration of significance. This is again 
because the estimates of Treatment effect vary slightly in their reliability, 
depending on how many observations are Involved in each. 

In Table XXV the number of degrees of freedom left after the control and 
experimental faGtors have been handled is the number of observations less the 
number of Independent constants estimated. These factors are, of course, 
exactly the same as in the full Design bo the freedom assigned them is also 
the same. The loss in freedom is confi-ned to the residual variability. 

The test of significance is again alightly upset by all Treatments not 
appearing an equal number of times. We shall again Judge the value of 
F a little the more startling than is proper. To put the matter another 
way, it is as if Table L gave us a value a little too low. By this It 
is meant that the 5^ or 1 % level of significance should be slightly higher 
than it comes from Table L, 
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It may be. of some interest to note that in Table X3CV the adjusted 

A A 

mean for a Treatmen't, i.e., Y-,, + y » Is "the same as ■the corresponding 

value in ’TaTple XDC^ "Without allowance for Carry-over, or in Table XXI , 
with allowance for Carry-over, for k- (l),(2),(3) or (6). These are 
Treatments that lack no observatlonj the Information on them is not 
affected by the misses and their average is unchanged. 
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VI. Analysis of data from a single Youden ^ t x c x t 

Ihe general nature of data from a Youden rectangle 

Estimation of direct treatment effects only In a single 

Youden rectangle ...... 

of significajiGe for direct treatment effects alone . , . 

BreaJting treatment variatillty up 

■^3'lysis wltli allowance for Carry-over In Youden rectangles . . 

Explicit solution for simple cases of Carry-over ......... 

Youden rectangles with missing Rows 

Youden rectangles with missing cells .......... 
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The general nature of data from a Youden rectangle - We must consider the 
prohlem of dealing with data from a single Youden ^ c < t g in the light of 
discussion of data from a latln sqtuare, as in the Just previous Chap. V. The 
necessity arises ^ in part ^ from the fact that all hiometrical analysis is 
thus written; it is dominated by the foiins and concepts of the latin square 
or at least its degenerate form the balanced block* It arises j in the second 
part 5 because a great many readers must be already familiar with such analysis 
and so it is wise both to take advantage of that familiarity and to warn 
against it. Youden rectangles differ from the squares first in that the 
nature of the analysis is not so obvious* The Treatments are heavily con- 
founded with Rows BO that it Is not enough to look over some data and say 
'Veil, Treatment (?) is the highest, anyhow*" It does not necessarily follow 
that (7) is best because it may simply have happened that Treatment (T) was 
assigned to Rows that proved high almost regariless of the Treatment put into 
them* The analysis of variance with which so many of us are extremely familiar 
breaks down. Since the Rows and Treatments not orthogonal the sum of 

squares to be ascribed to each dependB on the order of their consideration. 

The matter may be more clear if we think of it in teMis of the reduction of 
residual variability (or squares ). Then the reduction in reBldual variability 
for Treatments is one thing if that for Rows is made first but quite another 
thing if the reduction for Treatments is made first and then that for^ Rows . 

In any case the simi of squares of the usual analysis of variance does not on 
division by the degrees of freedom yield in ^y clear ^d assured way the mean 
square which may be tasted for error. The literature on the subject of 
analysing Youden rectangles ’consists of data writhing on the ^ocrustean 
analysis of variance. 
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The diffictil'bies to 'which allusion has Just "been made obtain for a 
Youden rectangle when one is simply tiying to deal with direct treatment 
effects without any complication of Carry-over. When this type of analysis 
is extended to embrace carry-over effects , the contortions are indeed 
dreadful I such efforts are enough to diBengcLge people from this admirable 
experimental point of view. Perhaps that is why it has been used so little. 

As an example 5 Patterson and Lucas (1962) in their learned review of change- 
o'^er experiments attempt to force the analysis of their data into the foimi 
of an analysis of variance, A reform of view-point helps. The development 
of electronic computers that can set up equations and then solve them very 
rapidly is also a help. Perhaps new times are at hand end we shall use 
change-over Youden rectangles j making allowance for Carry-over, very freely 
and discover many things that will help the fields of application that are 
Involved. 

For the Youden rectangle it is best to follow the treatment, alterna- 
tive to classical analysis of variance, as for the latin square Just 
discussed, and which is reconmended for the more complicated cases. In 
general, we set up the least squares equations for the model involving 
all things likely to control variability, l,e, , Rows and Columns and get 
the residual variability. Then we extend the model to includ.e Treatments 
and again find residual variability and reduction in variability. G?his 
we consider against the variability residual on the total model, with due 
allowance . for degrees of freedom strike the P ratio and decide on significance. 

For single Youdens It Is possible to have a 0^^ conditioning Period 
of the same Treatment as the 1 time experimental Period, just as has 
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been shown previously for the latin square* It is nob^ however^ particu- 
larly profitable because the Change-over is still not balanced. In a 
IToudenj a given Treatinent far Is to be preceded by other Treatpients than 
itself. Accordingly^ all the Youden rectangles^ c < t ^ that follow are 
imconditionlng Design, 



Estimation of direct treatment effeuta only in a single Youden rectangle - 
The Gomparatively simple question of direct treatment effects in the single 
complete Youden rectangle^ txcxt 5C<t 5 will be considered alone 



for two reasons. First 5 it is amenable to explicit solution. Secondly ^ 
the related problem of testing the significance of treatment effects can be 
handled in so many ways and is so heavily involved with the literature that 
it is discussed separately in the following section. As an example of the 
results gotten by running a single Youden ^ consider Table 3 QCVI ^ when the 
Result was poimds of steel produced ^der 7 Oils which were tried on each of 7 
Machines over Periods of operation ^ i.e.^ 7 x^x 7 . The Treatments are dis- 



posed according to the Design shown in Table XIII, The circimiste a. 



this Design is arrsinged with cyclic Columns is immaterial in analysis for 
direct effects^ without consideration of Carry-over. The present diBCuSBlon 
applies to Youden rectangles in general. 

As previously 3 for the latin square^ we may say we get the Result , 






under 



-■fch _ 

5 in the 1 Row, i.e 
t h 

■tile k Treatment , 



, Machine, in' the Column, i.e.. Period, 

following the model of Eq.u. (T). Again, it may 



be observed that the business of getting a sum of all observations y. 

1 Jk 

relevant to an effect such as that of Oil or Treatment (l), plus such Irrelevant 
quantities a‘s are unavoidable, and then the averaging of the values y. 



ijk 



IS 



really the essence of the method of least squares. It is necessary to turn from 

O 
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the total effect of a Treatment such as (l) to some sort of average effect, 

that ia , the amount such a Treatment may he said to affect a single ohserva- 

tion V suhiect to it. It is necessary to remove, as best possible, the 

•"ijk 

irrelevant contributions . Since each Treatment occurs in all Columns , these 
two effects are not confounded , but , of course, only some Treatments can occur 
in a given Row so that there confounding does occur . If the sum for each 
Treatment Is fomiad there result the equations, 

Uy - U3 - - ctg + 4 yi = 1339*^ 

4y - ay - as - U7 + 4 y2 - 1289 . 0 

4y - as - ag - ai + 4 y3 ^ 1509.^ 



A ^ A 

Uy - 02 -• ^3 - “ 1523-1 



Accordingly it is necessary to find the sums 
for Rows , 1 . e . , 



or least squares equations 



4y + Uoj - Y 3 “ Y5 “ Ye = 1205.5 

" " " ■' ^ 1 
Uy + 4 u2 -Y4“Y6”Y7” i497-5 

Uy + Uog -- YS ~ Y? ” Yi “ 1221.7 



( 110 ) 



Uy + 4 o7 - Y 2 “ Y 4 " Ys " 1526.2 

and deal with the general constant y , We must find the overall total 



and write 



28y - 10,244.4 
V ^ 365.9 
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The simplification is due to the fact that in the overall total all Rows 
are represented equally (T times) and due to Equ. (9)s therefore, come to 
naught. Similarl 7 the Column totals come to naught. The solution of these 
equations provides the estimates of Treatment effects shown in Tahle XXV Ih . 

So long as one is dealing, as we are here, with perfect and regular 
Youden rectangles, one may eatimate the effect of the It Treatment or Oil 
explicitly as 

... .. cSy. - ET. 

Yj^ or (k) = 3. ( 112 ) 

where y is any observation under Oil k and where T Is the sum of 

IJk - 1 

the observations for any Bow in which k occur- Thus the estimate of the 
effect of an Oil (l) is 5 following Equ- (112) from Table XXVI: 

or (1) = {4(272.9) - 1205.5 + 4(316.4) - 1497.5 + 4(412.2) - i644.3 + 
4(337.9) - 1526.2 }/i4 

= = 36.8 . (113) 

The estimates gotten in this way of the effect of all Oils are as shown in 
Table XXVIb. As a munerlcaj. check the sum of the estimates, of course, total 
"bo zero. Trie estiinates froiTi Equ, (ll2) are least squares estimates and ac? 
such can be later applied in the equations, where we deal with residual 
variability. The Youden conditions not only give a powerful comparison of 
Treatments 5 in the sense of the compar5.son table as in Tables I , II and III, 
but the very tidy set of least squares equations (IO 9 ), (llO) and (ill), which 
lead to the simple explicit result of Equ, (ll2). This is true, of course, 
only so long as the Design is exactly complete, without missing or extra Rows, 
"but this happeneth rarely." Prom the experimental point of view Equ. (112) 
is interesting because it shows clearly that the rating put on a Treatment or 

Er|c b ; 

do / 
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Oil is indeed not- its total response but that total adjust ed^ as is intuitively 
attractive 3 for the Rov or Machine where it occurs. 

The quantities shown in Table XXVIb as Adjusted Mean ware forined by addings 

A A 

for each Treatment ^ (k) to u * They are comparable to the true means from 

a latin square in that they ..average to p and yield the contributions when that 
is subtracted from each of their. 'Hiey are essentially estimates of what the 
mean would have been if a given Treatment had been tried in all Rows . They are 
very useful quartitles in reporting work because they are necessarily of the 
correct magnitude for whatever phenomenon is under consideration. 

Let us consider first the method of squeezing the problem into the form 
of the analysis of variance which appears wiiely in the ataiidard literature* 

It all gives much the same analysis and draws very much the same conclusions. 

Let us consider the discussion of Cochran and Cox (1957" 509) in some detail. 



We are concerned with their ’^Analysis with recovery of inter-block information ^ ” 
not at all with the alternative restricted to intra-block variability. The 
latter is a slightly more simple variant that is more or less admissible imder 
certain circumstances. For a single Youden with t - nimber of Treatments ^ 
c = number of Colimins end r ~ number of Rows 5 the procedure is : 

a. Find coliaim totals, block totals and corner or grand total G. 

b. Write a column of treatment totals as T i.e., the total for all 

observation under Treatment k, 

c« In a column beside that of T, write a coliamn of • the total of row sums 

iC Ic ' 

for all Rows in which a given Jtth Treatment occur. 

d. Write a 4th coli^on of the quantities, 

Wj^ ^ (t-c) - (t-1) + (c-1) G (Il4) 

e. Write the analysis of sums of squares and mean squares; 
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Source 


1 


Sum Squares 


Hcan Square 


Rows (adjusted) 








Columns 


c-1 






TreatoGnt/ (unadjusted) 


t-1 






Residual/ 


(c-2) (c-l) 




Ep=S^/(c-2) (t-1) 


V Total*' ' j 


j tc-1 







Here sums of squares for "Total 5 " for Columns and for Treatments are found 
by the usual methods, without consideration' of the Design, i.e., fiom Equ, (13) 
and ( 1 ^). The adjusted sum of squares for Hows is the sum of squares of the 
quantities divided by ct(t - c)(g - l) . Sum of squares for error is 

gotten by subtraction, in a fashion after Equ. (l5)- 
ft Calculate une quantity 



M 



t(c - l)E 



and then the adjusted mean for the 



. th 

K 



Treatment is 



(k) ^ T - MW, 

iC iC 



(115) 



(116) 



which is, of course, a restatement of Equ. (112). 

g. Finally, a method is given for testing the significance of the difference 
between such estimates for any two Treatments . Into this it seems 
wisest not to go. 



Analysis of slaniflcance for direct treatment effects alone - 'When it comes 
to the analysis of significance for direct Treatment alone, even though the 
Design may be a Change-over, one is simply dealing with a Youden rectangle in 
a form on which there exists a considerable literature. This cannot be ignored. 



even though it does not seem so handy, as it might be, to the writer. This 



corpus will be first consider'sd because people may still test significance by 

er|c ,.i 
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Table XXyj — PoTjnds of steely by 7 Machines over ^ Periods 

•with 7 experimental Oils 

a. Data 



lerlod 



Machine 


1234 


Siinri 


I 


(1)272,9 ( 2 ) 302.4 (4)349.1 ( 7 ) 281.1 


I 5205. 5 


, 11 


(2)384.4 (3)424.7 (5)372.0 (l)31^.4 


1 5 497. 5 


III 


( 3 ) 292,9 (4)356.4 ( 6 ) 374.2 ( 2 ) 198.2 


1 5 221 . 7 


IV 


(4)530.2 (5)425.2 (7)309.9 (3)464.7 


I 5 T 3 O.O 


V 


( 5 ) 304.1 ( 6 ) 510,6 (i)4i2,2 (4)4i7.4 


1,644.3 


VI 


( 6 ) 319.0 ( 7 ) 474.3 (2)4o4.o ( 5 ) 221,9 


1,419.2 


VII 


(T)457.8 ( 1 ) 337.9 ( 3 ) 327.1 (6)403.4 


1 5 526. 2 


Sum j 


25561.3 2 , 831.5 25548.5 2,303.1 


10,244.4 



Su.1 sq. 992 , 958.87 936 , 437.71 

151795^81.11 82O5549.J+3 



b. Treatment (Oils) estimate s 





(1) 


I 2 ) 


(3) 


(4) 


(5) 


(6) 


( 7 ) 


Contr . 


— 36 . 8 


- 13.4 


+4.4 


+57 . 9 


-71-3 


+44.1 


+ 15.1 


Ad J , Mn . 


329.1 


352.5 


370.3 


423.8 


294.6 


4l0.0 


381.0 





189 



using a desk calculator, and this is quite practical if one has only a single 
and perfect Youden rectangle, without consideration of possible Carry-over. 

It lias the further advantage of being logically available to people used to 
thinking in terms of analysis of variance. Secondly, from essentially the 
same viewpoint certain modi float ions will be suggested. They again apply to 
the single and perfect Youden rectangle, without allowance for poBslble 
Carry-over and are entirely practical on a, desk calculator. Flna,lly, there 
will be presented a third handling written in terms of least squares equations 
and variability residual from them--all this Just as has been done immediately 
previously for latin squares . This last technique is preferable in that it 
disdains the singleness of perfection of the Youden rectangle. It can, of 
course, and will be extended to the situation where allowance is made for 
possible Carry-over. The reader, unacquainted with the literature and essen- 
tially inclined to getting a Job done, is advised to skip to this third 
general method of handling the data. 

Let us, for the moment, lllustr the foregoing discussion on the data 
of Table XXVI, the 7 x 4 x 7 , on Machines and Oils. This is done in Table 
xr/IIa. In particular ws nets that Equ. (ll 4 ) becomes 

% “ + 30 (117) 

The adjusted sum of squares for Rows is 

{(-480. d)2 + (+2,536.8)2 + ... + (+17.1}2 j/(4)(t)(3)(3) 

- 69,592.93 . . (118) 

So far as the other sums of squares, which are simply those gotten from any 
standard analysis of variance, are concerned they are from Equ. (13), 



O 
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Sj, = (’ [{2, 56..J)® +...+(2,303.1)®] - (io,244.4)®)/28 

' -99 (U9) 

and from Equ. (l^), 

= (28[ (272.9)^ + (302.4)^ +...+ (403.4)®] - (io, 24>' .4'i®]/g8 
= 181,293.86 . ( 12 Q) 

The value of is gotten l:y differencing. For the sajke of convenience 

there appears in the same Tahle a part XXVIIb which is aii alternate form of 
the analysis of varlahce as will he dlBcussed immediately and JOCVlic, which 
is the corresponding analysis on the hasis of least squares equations. The 
latter will be discussed In due course. 

It should he noted that two operations are going on in the above procedure 
The quantities that we have called sum of squares are found so that we can 
conveniently estimate error sum of squares by the sut fraction of Periods and 
Machines from total variability. They are foimd for this purpose and nothing 
else. The sum of squares for something like Eovs is simply the reduction in 
total variability achieved by the eonalderatlon of Rows, '^e quantities called 
mean squares are found so that w® can test significance , Thus the mean square 
due to Rows is the estimate that we should make from among the Rows of the 
unit variability if the data were to consist of random normal deviates. These 
two kinds of quantities, sums of squares and mean squares, are not necessarijly 
related in a simple way. The misleading circumstance is that they are simply 
related in the less Involved Designs such as latin squares. TOiere all sums 
of squares are divided by comparatively simple associated Integers called 
degrees of freedom to yield mean squares suitable for testing if necessary. 

'nils has been so much the case that the widely known analysis of variance is 
thought of as fundamental. In the development of statistical analysis there 
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Table XXVII- Analysis of variance for Youden, 7 x 4 x 7 , wlthp-ut Carry-over . 
Data of Table XXVI 



a. Analysis following the literature 



ITeatment' 


Tk 


Sk 


Wk 


(1) 


1,339.4 


5,e73.5 


- 489.6 


(2) 


1,289.0 


5,343.9 


+2,536.8 


(3) 


1,509.4 


5,975.4 


- 591.0 


(4) 


1,653.1 


5,801.5 


.+ 883.5 


‘ (5) 


1,323.2 


6,291.0 


-3,043.2 


<6) 


1,607.2 


5,811.4 


+ 686.4 


(7) , 


1,523.1 


5,880.9 


+ 17.1 




10,244.4 


40,977.6 


.0 



Source 


d. f . 


Sum Square 3 


Mean Square 


F 


Ro’w^s (adj ) 


6 


69,592.93 


11,598.82 


2.33 N.S. 


Coli^^s or Periods 


3 


19,976.99 


6,658.93 


1.34 N.S. 


Treatments or Oils (unadj ) 


6 


31,947.99 







Re si duals 


12 


59,775.95 


4,981.33 




"Total" 


27 


181,293.86 







b. Analysis 'When the roles of Rows and Treatriients are interchanged 



Period 



Treat- 

ment 


* 


1 




2 




3 




4 


Sum 


(- 1 ) 


i I 


272.9 


VII 


337.9 


V 


412.2 


II 


316.4 


1,339.4 


( 2 ) 


! II 


384.4 


I 


302.4 


VI 


4o4.o 


III 


198.2 


1,289.0 


( 3 ) 


’ III 


292.9 


II 


424.7 


VII 


327.1 


IV 


464.7 


1,509.4 


( 4 ) 


, IV 


530.2 


•III 


356.4 


I 


349.1 


V 


417.4 


1,653.1 


( 5 ) 


\ V 


304.1 


IV 


425.2 


II 


372.0 


VI 


221.9 i 


1 , 323.2 


( 6 ) 


; VI 


319.0 


V 


510.6 


III 


374.2 


VII 


403.4 ; 


1,607.2 


( 7 ) 


; VII 
1 

H 


457.8 


VI 


474.3 


IV 


309.9 


I 


281.1 ! 


1 , 523.1 


Sum 


1 2 , 
i 


561.3 


2 , 


831.5 


2 , 


548.5 


a, 


— — ^ 

303.1 ^ 


10 , 244.4 




i 
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Row 


T! 

1 


S.' 

1 


W! 

X 


I 


1,205.5 


5,804.6 


-477.9 


II 


1,497.5 


5 , 461.0 


+2,459.7 


III 


1,221.7 


6 , 058 . 7 


-1,953.9 


IV 


' 1 , 730.0 


6 , 008.8 


-129 . 6 


V 


1 , 61 ; 4.3 


5,922.9 


+128 . 7 


VI 


1 , 419 . 2 


5 , 742.5 


+535.8 


VII 


1,526.2 


5 , 979.1 


-562.8 


Stun 


10 , 244.4 


40 , 977.6 


.0 



■sourc e 

Rows or Machines (unadj ) 
Coliunns or Periods 
Treatments or Oils (adj) 
Residuals 



"Total” 



!d.f . 



12 



27 



Sim Squares [Mean Rnnayp 

58 , 947.98 — 

19 » 976.99 6^656.93 

,592.9k 7,098.82 

59,775.95 4,981.31 



181,293.86 



1.34 W. 
1.42 w. 



G. Analysis directly from least squares equations 



Factors 

U 5 Rows and Colunms (control) 
Control factors plus Treatments 



d. f . 

18 

12 



Residual Variability 
(Squares) 

102,368.89 
59,775 94 



n ^ (102 , 368 . 89 , - 59 , 775 . 94 ) /6 

6,12 59,775.94/12 



1.43 N.S, 



O 
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has arisen a coniusion of realities and means. The systematic association 
of sums of sq_uares and mean squares is well enough for a situation without 
systematic confounding but stands us in poor stead now. This confusion 
arising from form is hard to shake since it comes from the Olympian pen of 
Sir Ronald Fisher. It is also hard, of course, because the point of view of 
the analysis of variance remains extremely useful in certain connections, 
such as uhat of breaking up the variability among Treatments. It should be 
understood that the distinction between smns of squares and inesn squares here 
made is the view of the writer and will not be found generally in the litera- 
ture. In connection with the procedure that we recommend for the test of 
significance of Treatments in the single Youden rectangle note that in this 
problem there is no simple relationship between elements that play the classic 
role of sums of squares in the analysis of variance and elements that play 
the role of mean squares. It is the attempts in the literature to force such 
a relationship that make the analysis of single Youdens so hard to read 
and harder still to follow. 



The preceding approach may be bettered in two ways of which the first 
is that of inverting the roles of Rows and Treatments , A curious , and at 
first glance apparently trivial, circumstance is that if one rearrange the 
data, s of a Youdsn Desj.iJU, t x c x t , where entry is by, say. 

Subjects and Periods, to entry by Treatments and Periods, i.e., to values 



yjjj£ 5 the Design remains Youden,* t x c x t . To illustrate what is meant 
consider the Design^ in cyclic Columns^ for 7x4x7 ^ as follows: 



*Beall, G. Reversion of a Youden rectangle. Educational 
Testing Service, Princeton , N. J. (in process , 1971 ). 









Period 




Treat- 




Period 




Row 


1 


2 


3 


4 


ment 


1 


2 


3 


4 


I 


CD 


(2) 


(4) 


(7) 


(1) 


I 


VII 


V 


II 


II 


(2) 


(3) 


(5) 


(1) 


(2) 


II 


I 


VI 


III 


III 


(3) 


(4) 


(6) 


(2) 


(3) 


III 


II 


VII 


IV 


IV 


w 


(5) 


(7) 


(3) 


(4) 


iv 


III 


I 


V 


V 


(5) 


(6) 


(1) 


(4) 


(5) 


V 


IV 


II 


VI 


VI 


(6) 


(7) 


(2) 


(5) 


(6) 


VI 


V 


III 


VII 


VII 


(7) 


(1) 


(3) 


(6) 


(7) 


VII 


VI 


IV 


I 



The second Design will "be found Youden, in its way. This interchangeability 
of role of experimental Subject and Treatment luay be eniployed to maite estimates 

A A A 

of the effects, a^jOig , . . . , for Bow or Machine. In strict analogy to the 

estimates, (l (2 , for the Oils, from Equ. (112), the estimate for 
the i^^^ Machine is 



a . = 
a. 



°^yk.u “ 



f . 



( 121 ) 



where y . is any observatlan from Machine i and where Tj^ is the total 
kj 1 



for any line in the inverted table (involving now, of course, a given Oil) 
in which -1 occur. Thus the estimate for Machine I, of the data of Table 



XXVI, is 



i4(2T2.9) - 1339.4 + 4(301,4) - 1289.O + 4(349.1) - i653.1 + 
= - 70.2 . 



, 1 ) - 1523 . 1)/^=4 
( 122 ) 



Further, one can very simply rearrange matters so that Treatments rather than 
Rows are acljusted in the analysis of variance, and their mean square can then 
be t'-sted for significance. Thus like Equ. (ll4), 

= 3T^ - 6S^ + 3G , (123) 




with the roles of Rows and Treatments reversed. So matters would be much mended. 
This has been done in Table XXVIIb. So tar as the sum of squares (unadjusted) 
-for Rows is concerned, this is now,, simply, from Equ. (13), 

i. 

196 



( 124 ) 



Sp = ( 7 C ( 1 , 205 . 5 )^ +...+ ( 1 , 526 . 2 )^] - ( 10 , 244 . 4)^ ]/28 

= 58,947.98 



The sum of squares for Rovs and Columns, respectively, and that for "Total" 
may he gotten in various ■ways, one of which might he hy classical analysis 
of variance (omitting Treatment) as from Equ. (l3). 

The analysis of variance, from the literature and as illustrated in 
Table XXVIIa,with its adjusted row effects and unadjusted treatment effects, 
seems aimed principally at getting a scheme such that the sum of squares 
for Residuals can be gotten by subtraction. The mean square for Treatments 
cannot be tested for significance against the Residuals , which seems a 
pity* There is not, explicitly, an F test aiiiong Treatments in general. 

Tie mean square for Rows can be tested, by the usual ratio method, against 
Residuals although this seems an idle thing. There is little point in 
showing that one 's experimental arrangement was worthwhile. Matters can be 
arranged more profitably as just discussed and as illustrated in Table XXVIIb, 
Now the adjusted sum of squares for Treatments can be tested agaln-t residual 
variability and tals is a thing worth doing, if it is worthwhile at all to 
make a test of significance. 

It may be noted that the analysis of variance in Table XXVIIb is. In 
a fundamental way, Identical with the analysis proposed in the previous 
section, on least square equations. The "Total" is the sum of squares 
reduced by the estimate of y . The sums of squares for Rows and Columns 
are the reductions due to the control factors, without any allowance for 
Treatment. Finally, the sum of squares for Treatments (adjusted) 
is the further reduction in the sum of squares due to their Introduction 
into the nodel. 



O 
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Granted that the analysis may he bettered by testing the Treatments 
rather than the Rows $ a second betterment is to simplify the calculation 
of the sum of squares and mean square for Treatments (adjusted), as in 
Table XXVIIb, by using a relationship that seems to have been generally 
overlooked, viz., that the sum of squares for Treatments (adjusted) Is* 

g, ^ I (k)2 (125) 

" 1 t 

■which can be calculated very simply from the treatment estimates or 

(k) as in Equ. (112). The mean square Is 



E 



T 



(c - l)t 
(t - 1)2 



2 (k)2 

t 



Thus one avoids the complicated' little sub— table of T^ , and of 

Table XXVIIb. Then the analysis of variance becomes fairly practical. The 
present discussion may be illustrated on the data of Table XXVI. We have 
from Equ. (125) with the results of Table XXVIb 

S* -1121 r<-36^8)2 + (-13.4)2 +.. .+ (+15.1)2] 

T 6 - / 

- 42,567.28 (12T) 

or, if the estimates, (k) , are calculated with more decimal places 

42,592.94, as shown in the iuisJ.ysis of sms of squares of Table 3DC.VIIb. 



*Beall, G- On finding the adjusted sum of squares for Treatments in a 



EduGational Testing Service, Princeton, N, J, 
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Youden rectangle, 
(in process 1971 ) 
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If one should want a mean square for Machines that may properly be 
compared with Residual it may also be gotten, parallel to Equ. (125) 
from the row or machine estimates of results such as Equ. (135), in the form 



E 



R 



(c - l)t ^2 

(t - 1)2 * 



or for the data of Table XXVI, as 

?[(-T0.2)2 + (+37.8)2 +. . .+(+9.0)2]/12 = 11,599.33 



(128) 



(129) 



and this may be used with the Residuals mean squar*e of Table XXVIIa or b, 
to strike an F ratio. 

As originally stated, an alternative to the methods of ahalysis of 
variance Just reported there Is the method of working with least squares 
equations. This is still prefereble to using analysis of variance in 

that the fornier will fit in with the necessity of going on to more elaborate 
models involving repeated Design, missing data. Carry-over etc. Eie former 
has generality. It is not immediately suitahle for working with a desk 
calculator, in maiiy cases. It works out admirably with an electronic com- 
puter, as in the Appendix program. It can also be used in what Is termed a 
hybrid procedure at the termination of the present section. For a single 
Youden rectangle it is necessary to set up the least squares equations hy 
forming the rather obvious sums for all observations Involving a given effect 
and then solve the equations on an electronic computer, if that be available. 
The best way , if matters stand favorably, is simply to give the Design and 
data to the appropriate appendix program and let it work the whole matter out 
This procedure is exactly the same, in principle, as for the latin square. 
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For the data of Table X5CVI , to test the significance of treatment 
effects, it Is first necessary to find the variahillty residual on the 

A 

control factors of u 9 Rows and Columns • The estimate for y 
Is as in Eq.u.(lll). Forming totals for the Rows, we may say 



4y + 4a 1 = 1205.5 
4y + 4a2 = 149T.5 

A A ^ 

4y + 4 q 3 ^ 1221.7 ^ 
4y + 4tt7 — 1526.2 j 



Accordingly, we may say that before allowance is made for treatment effects 
the row effects are: 



^i- 



-64.5 



+8 . 



. 60.4 +66.6 + 45.2 - 11.1 + 15.7 



Similarly for Columns 

7y + 7 /^^ = 2 , 561.3 ' 

7y + ^ 29831,5 

7y + 7i»3 = 29548.5 

7w + 7^ = 2,303.1 , 

and 

h h h : h 

+.0 + 38.6 - 1.8 - 36.9 ' 



(131) 



(132) 



(133) 



Accordingly we find the residual variability (sq_uares) on th« control 



factors is: 





3, 929*^27. 12 - 365.87(10,244.1) 

- {-64*5(1205.3) + 8.5(i49?.5)... + 15.7(1526.2)} 

- {+.0(2561.3) + 38.6(2831.5) - 1.8(2548.5) - 36.9(2303.1)} 

= 1025368.89 (( 134 ) 



as shown in Tahle XXVIIc. 

For contrast with the foregoing it is necessary to eatlmate the con- 
stants and find the residual sq.uares when Treatment is added, as in Eq.u, 
(43), to the model, over and above the control factors. The equations for 
Rows have to be rewritten, of course, because Treatment is confounded with 
Rows, i.e., is not balanced from Row to Row. Accordingly, we must replace 
Equ. (130) by Iqu.(llO), as previously, or on the lines of Equ. (122), to 
get estimates for Rows as follows i 



a£ ag U4 ag oig 

-70.2 +37.8 -83.7 +65.1 +46.7 -4.7 +9.0 



(135) 



We must complete with the estimates for Treatments (Oils) shown in Table 
XXVIb, which were calculated from Equ. (l09)* Using all the estimates 
and right-hand members of Equ. (ill), (132)* (llO) and (l09)'W'e get residual 



squares of 

3,929,427.12 - 365.87(10,244.4) 

- {-70.2(1205.5) + 37. 8(1497.5 ). • . + 9.0(1526.2 )} 

- {+.0(2561.3) + 38.6(2831.5) - 1.8(2548.5) - 36.9(2303.1)} 

- {-36.8(1339.4) - 13.4(1289.0)... + 15.1(1523.1)} 



« 59*775.94 
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(actually using the coefficients with accuracy to the 6th decimal place) as 
shown in Table XXVIIc. The complete factor analysis, control and experi- 
mental, which corresponds to the classic analysis of variance is shown there 
In practice, it can, of course, he calculated directly by simply feeding the 
Design and data into the appropriate appendix program for an electronic 
computer . 

There is finally what may "be called a hybrid method of calculating 
significance that is highly practical for a desk calculator when one is 
working with a perfect , single ,Youden rectangle. The mebhod consists of 
employing the explicit solutions for Rows, as in Eq.u.(121) for Treatments, 
as in Equ. (l36; and, of course, for Columns from Equ. (l32), against the 
appropriate right-hand members, or sums of the simultaneous equations. 

This avoids the setting up of the left— hand members of the equations , 
let alone the general solution of the equations. Then all that remains 
to be done is the calculation of Equ. (134) and (136). 

Bi^eaking treatment variability up — Very often in a Youden rectangle, 
c < t , just as in a latin square, c t , it is necessary to consider 
some particular comparisons from among the effect of Treatments as a 
whole group. The best procedure is just the same, fundamentally. 

Work with the Treatment estimates sud having broken up correctly 
the variability among them reconcile the results to the overall discussion 
by a factor of K *■ Consider the data of Table 3DCVI on lb. of steel. 
Suppose it were feqmred to compare Oils (l) and (2) with all other Oils, 
as a group. Then on the lines of Equ. (36) there is found- a factor K 
related to the total reduction in squares for Treatments. This is the 

O 
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Siam of sq_uares (adjusted) for Treatments in the analysis of variance of 
■Table XXVIIb or the reduction in sq.uares due to Treatments, i.e., 102,368.39 
- 59,775.94 = 42,592.95, of Table X3G/II c. In any case. 



K 



^ 42,592.94 

(-36.8)^ + (-13.4)^ + (+4.4)^ +) (+57-9)- + (-71.3)^ + (+44.l)^ +(+l5.l)'^ 



3 . 5021 ' 



(137) 



If this value had been based on estimate of treatment effect "with more 
decimal places, as it ■would be on calculation not intended for illustration, 
it would be exactly 3* 5. This is plain in the situation of a perfect 
Youden rectangle from Equ.(l23) from which 



K = ^ S^/E (k) . (138), 

” k 

Now we may say that variability due to (l) + (2) versus the rest of the 
Treatments is 

^ ^ . (-36.8 -13.4)2 . ( + k,k + 57.9 - 71.3 + 44.1 4- 15,.,l)l ^ 

3.5'i — — ; 

= 3.5{(50.2)2}3/4 

^ 6615.105 . (139) 

Now this value is to be compared with the final residual variability (after 
effect of Treatments is removed) to yield 

F 266 1 5.105 /4981.31 ^1.33 (l4o) 

1,12 

which is not significant. It should be further observed that in the present 
case where, since the Youden rectangle is perfect, each Treatmeiit is repre- 
sented the same number of times, the test is exact. There is no need for 

the demur that was necessary in the case of a latin square with a Row or 

O 
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Rows missing and that will be necessary 5 again, for a Youden rectangle, when 
such omission occurs. 

It will be observed that in the Immediately foregoing paragraph the 
variability among Treatnients is as easily brolven up as It was for the latin 
square in Chap. V, Here, however, there seems to be no other practical 
way of doing it while, under peculiar simplifying conditions, there 
was an alternate and standard way of attending to the matter. It was, 
however, on accomt of the generality of the method used in the preceding 
paragraph that the present method was there introduced. Further , the 
present method can be extended to even more rficalcltrant situations, 
as will appear later, 

Pinally, It may be of Interest to consider the problem of comparing 
two treatment means—this Is a subject that the standard discussion in 
the literature stresses. Suppose that for the situation of Table 3QCVIb, 
it were required to find the significance of the difference between 
Treatments (2) and ( 6 ). Then following Equ. ( 35 ) and (l37) 

E = K[(2)2 + \ 6 )^ - ] 

= I {(h - 

= 3.5( - 13. *t - Itlt. 1)^/2 
= 5785.94 . 

Then 

' ^1 12 * ^ 
which is not significant. 
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Analysis vith allowance for Carry-over In Youd en rectangle^ - In Chap. II, 
it was suggested that Carry-over of treatment effects may often he consider 



Youden rectangles have made allowance for Change-over. That is, a given 
Treatment is not preeedad hy any other Treatment more than once. With such 
Designs we may at least comfort ourselves that Carry— over , if it occur, will 
be confounded In a sma].l and presumably minimal way with treatment effects. 

The matter often stops there, It may j however, be necessary to free estimates 
of treatment effects from Carry-over. It may further be recjuired to get 
Carry-over out of the residual mean square which is blown up by it. There are even 
times when it is of great practical importance to estimate Change-over 
itself. Thus, in one way or another we are often under the necessity of 
ajialyzing for Change— over, in a manner similar to that in which it was treated 
in Chap. V, for latin square Design. For the Youden rectangle, however, 
there will be shown only cases without a conditioning Period. There is not 
much point to putting in conditioning Periods, because the Carry-over would 
still not be balanced; in the Youden rectangle a given Treatnient is not pre- 
ceded (or followed) by all other Treatments than Itself, The defect Is not so 
simple as in the case of a latin square nor remedied In such a simple w^. 

In the data of Table XXVIII, used to Illustrate the problem of dealing 
with Carry-over in a Youden rectangle, c t , without conditioning 
previous Period, it la assumed that the background was at least substantially 
the same for all Treatments in the first experimental Period, as for the 
corresponding latin squares previously discussed. Thus for the first Column 

or Period of a Design, such as that of Table XXVIIIa, it must be supposed 
that the model of Equ. ( 7 ) still obtains, i.e., there is no term for Carry- 
) '"er. It is supposed uniform for all items In the first Column and hence 



i, 



Lble and should be allowed for. On this basis the Designs presented for 
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completely confounded with the effect of the first Column. It is completely 



confounded with the general effect of the first Column and so for this 
Colunm we must simplify our model. Otherwise we proceed as previously for 
the latln square with a conditioning Period. Equ. (h3) is the model 
ottalning. 

An illustration of a Youden rectangle, subject to analysis for Carry- 
over is provided by an 11x5x11, f = 2 . Each of 11 Groups of men were 
subject to one Treatment for a Week and 5 Treatments over 5 Weeks, There 
were 11 Treatments. Each week each Group yielded a percentage of satis- 



faction. The Design and results are shown in Table lOTV^IIIa, 

Thi business of analysis again Involves setting up least squares 



equations ..or the effects, y 
various levels of the models 
variability variously residual 



» s 3 li anfl 'S, apprcpri ate 

1 J k k. - 

of Equ. (T) and Equ. (iiS) and finding 
. The handiest thing to do seems tu be 



set up the full equations , as in Equ. (^8), previously, and then cut 
back to the lesser situations by judiciously dropping rows and columns . 
Examining Table lOrViHa, it is at once apparent that the grand total, 3768 
contains all effects of Rows, Columns, Treatments and Carrles-over equally. 



so that we may write 



55u ^ 3768 

y - 68.51 (1^2) 



which is shown as the first line of the grand set of Equ. (l45). When it 
comes to estimating the effect of Rows , It is necessary to recognize that 
their totals contain no effect of Column , in the sense that they contain them 



all equally and remembering Equ, ( 9 ). 
contains much effect of Treatment. Thus 



On the other hand the total for Row 
for Row, or Group I, there Eue 
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present Treatments (l), (2), (4), (?) and (3,1). It is no gain to convert 
this statement into one that it lacks Treatments (3), (5), (6), (8), (9) and 
(lO). The total for Row I must also contain 4 Carries-over . Thus there may- 
be written 

^ ^ ^ 

5 y + 5^1 + Y 1 + Y2 + Y 4 + Y7 + Yu + 6i + 62 + 64 + 67 » 3768 (143) 

which is the second line of Equ. (l45). Others may be written likewise, as 
shown in the following lines. In the twelfth line the corresponding statemen't 
is not made hut rather there is, again, an appeal to the condition of Equ. ( 9 ), 
to avoid the algebraic problem oi" singularity. If Equ. (l45) are treated as 
a set of simultaneous equations. For Columns the equations are: 



lly + 11$ 1 - 806 



lly 




“ TTl 



> ' 



(il4) 



$1 + $2 + $3 + $4 + $5 ^ 0 J 

These are not included in Equ. ( 145 ) because it is somewhat bull^ anyhow. 
Treatments and Carries-over are extensively and Intimately confounded with 
each other and with Rows, as set forth in Equ. (l45)» In addition there is 
the peculiarity that each Carry-over la confounded with Coliamn 1, although 



it Is free of them! We have: 
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Let us concern ourselves first with the q.uestion of testing significance 
of the efiects of direct Treatment, alone, l.e,, without consideration of 
possihle Garry— over . This will, of course, he as in the preceding section, 
in connection with Table X 3 CVII. It may "b^. summarized largely by saying that 
"bhe vari^^^ili’ty i^esidual on thB control factors ^ ^ Rows and ColTunns can 

"be found by analysis of variance techniques 5 as discussed previously in 
connection with the latin square. The estimates are as in Equ. (itg) ^ for 
Rows as from the first 12 lines and coliniins of Equ, (l 45 ) 5 



a2 0^3 ^4 ^5 ^6 ^7 ^9 o^lO ^11 

+7,29 +.29 -5.71 +6.89 +.89 +l.i <-9 -.31 -2.31 -I.91 -7.11 +.49 



(1I+6) 



and from Equ. (l 44 ) , 

^ A ^ 

Bi $2 03 04 05 

+h,76 -5.51 -3.1^2 +1.58 +2.58 

The residual •variability on estimates of 
factors, is: 

261,576 - 68.51(3768) 

- { +7.29(379) + . 29 ( 34 U) - ... + .49(345)3- 

- { + 4.76(806) - 5.51(693) - ... + 2.58(782)} 

- 1639.96 ( 148 ) 

as shown in Table XJCVlIIb , if the thing be carried out with high accuracy, 
of the estimates. Then the situation increased by the consideration of the 
direct effect of Treatment will require consideration of Equ. (l 45 ) with the 
columns (25th through 35 th) and the correaponding lines eliminated, i.e., 
those involving the Carries-over . Thus we have the equations. 



( 147 ) 



Rows and Columns ^ s.s conbrol 





LA LA LA iC\ A A lA A LA A A A, A A A A A A A A A 
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A ^ ^ 



A ^ 



A ^ ^ ^ 



y Oil ^2 as «5 ag a? Ccg «9 «10“11 Tl T2 Y3 T4 Y5 ITS Y7 T8 Ta YlOTll 

1 1 



11 1 
111 
111 



1 

1 



111 • 1 
111 
111 



1 = 



1 = 



111 

111 



1 = 



lllllllllll 

1 1 



1 1 

111 



1.1 1 
111 



1 1 
111 



5 

1 

1 

1 



111 
1 11 



111 
111 
1 ; 

1 



1 1 

111 



1 11 1 1 11 1 1 

(The positions left empty contain zeroes, not shown) 
f'rom which the estimates for Rows are* 

^ A ^ 

ai ^2 ^3 ^4 ^5 ^6 



^ DUITI 




3768 


= 


379 




344 




314 




377 




347 




350 




341 


= 


331 




333 




307 




0 




356 




34 i 




377 


- 


360 




339 


= 


330 


— 


■ 371 


= 


312 




313 




307 




0 



^7 



»8 



ac 



a 



10 



0^11 



( 150 ) 



+4.77 -.23 -6.86 +5.95 +I.*i5 +1.86 +2.00 -3.64 +.77 -5.77 -32 

the estimatee for Treatment are as shown in Tahle xxyillb. while, of course, 
the estimates for Columns remain as in Ecu. (11*7). The residual variahillty 

now 'becomes 



O 

ERIC 



261,576 - 68.51(3768) 

- { + 4.77(379) - . 23 ( 344 ) - 

- { + 4 . 76 ( 806 ) - 5.51(693) - 

- { + 1.32(356) + .91(341) + 

^ 686 • 20 



. - . 32 ( 345 )} 

.. + 2 . 58 ( 782 )} 
. + 4 . 59 ( 362 )} 
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(151) 



U\ if\ 'LTk. .tA, lf\ lA IIA LA. U\ if\ LA. 



209 



if the thing be carried out -with higher accuracy, of the estimates. These 
Results are summarized in Table XXVIIIb; the value F is highly significant. 

The practical ■way of going about the analysis of a situation where 
there are Rows , Columns, with a possible trea'i'' ,xit effect and a possible 
carry-over effect is fundamentally the same as for latin squares, previously. 
It is as follows , Find the residual sum of squares on the Rows , Columns 
and Carry-over and then find the residual when direct Treatment is included. 
The question is then whether the reduction in residual squares due to the 
experimental Treatment, over the control factors, is significant. Following 
previous procedure, the columns involving and corresponding rows of 

Equ. ( 1 U 5 ) must be dropped, along the lines pf setting up Equ. (55) from 
(U8 ) . ¥e get : 



A A 



A A 



A A A A A 



A A A 



A A 



p 02 ^3 ^5 ^10*^1101 62 ^4 ^9 ^10^11 



. = Suii? 



11 

k 1 
h 11 
k 11 

h X 

h 1 

h 

hi 
k 1 

k 
k 



1 1 
1 1 

1 

1 



1 1 
1 1 



111 1 

11 1 

11 1 
11 1 
1 1 

1 .11 

1 

1 

1 1 

1 1 



lllllllll-ll 



11 

1 1 -1' h 

1 -1 4 

1 1-1 

1 -1 

1 -1 

1 -1 
-1 

11 -1 ' 

11 -1 ■ 

1 11-1 



11 1 
1 1 
1 1 



^ (The positions left empty contain zeroes, not shown) 
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11111, 111111 



379 

3hU 

3lh 

377 

3h7 

350 

3hl 

331 



307 

0 

806 

296 

267 



(152) 



267 

271 

267 



260 
263 
292 
0 J 
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We shall again he Interested in the variability residual on the eontrol 



factors, when Carry-over is regarded as a control factor. Solving Eq^u. 



(152) and Equ. (l 44 ), the results are; 



a ■ 



“2 






ai 



Oti 



OEf 



a, 



0.1 



Ot g 



aio ail 



+7.43 +1.66 - 4 . 80 +6.55 +1.67 +1.01 -.30 -1.02 - 4.25 -8.22 +.27 



Si 



B2 



S3 



(153) 



+4.76 -5.51 - 3.42 +1.58 +2.58 

Sill] iaEs] 63 C 3 ] fi4[4] fists] hih fi7[T] fiaCS] igEsl fiiotio] fiiitiij 



+5.57 -.71 “ 3.35 -1.80 +.02 -.10 -3. 



-2.82 +.70+7.24 -.99 



Finally it is necessary to multiply the estimates of Equ, (153) by the ap- 
propriate right-hand members of Equ. (l 44 ) and (l 45 ) to produce the residual 
variability on control factors in Table XXVlIIc, Thus there may be calculated 



261,576 - 68.51(3768) 

- { + 7.43(379) + 1 . 66 ( 344 ) + ... + .27(345)} 

- { + 4.76(806) - 5.51(693) + + 2.58(782)} 

- { + 5.57(296) - .71(267) + ... - .99(258)} 

= 1212.01 (154) 



or if estimates with more figures are used the result is 1213 . 02 , as shown 
in Table XX:viIIc, It is now necessary to find the estimates of effects and 
residual squares on the full model with y s Rows, Columns and Carries-over , 
as before, but also with Treatments, Equ. (l 44 ) remains undisturbed but 
Equ, (145) have to be employed In full. Solving, the estimates for Row 



O 
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effects become 
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ai Q2 as 0^4 as ag a? ag ag a^o '^ii 

^ : ( 155 ) 

+4.05 +-TT -10.56 +2.40 -.21 -1.63 +4.63 +1.04 +1.15 -1.82 +.19 

^ ^ A A 

while the estimates for y-u (k) and. 6 or [£] are as shown In 

Table XXVIIIc. The residual varlahllity ■becomes 

261,576 - 68.51(3768) 

- { + 4.05(379) +.77(344) - ... + .19(345)} 

- { + 4.76(806) - 5.51(693) + ... + 2 . 56 ( i " 2 )} 

- { + 3.44(356) + 1.86(341) + ... + 2.15(362)} 

- { - .19(296) - 8.00(267) - ... - 9.02(258)} 

= 250.86 (156) 

if the thing is carried out with higher accuracy 3 of the estimates These 
results are simunarlEed In Table XXVIIIc. The value of F has become even 
more highly significant with the Introduction of Carry-^over Into the model. 

To handle a Youden squares with possible Carry --over 5 the least squares 
equations must be solved on electronic computer^*^this Is neceBSary equipnient . 

It is impractical to solve the equations with a desk computer. Perhaps that 
is why the full and proper analysis of Carry-over did not appear historically 
sooner----there was hardly equipment to solve the necessary equations . It will 
be readily realised that the set of least squares equations may becoine intoler- 
ably large 3 particulSLrly J.f there are a great many Rows 3 as there often are 
In praotice. This difficulty can be avoided by certain procedures discussed 
in the Appendix on electronic progr^as 5 so that the size of the set of 
equations 5 to be dealt with 3 depends only on t and c . As was dlBcussed 
previously in connection with latln squares, onethere simply gives the inachlne 
the Design and the data so that it can set itself up the equations to solve, 

to calculate the various residual variabilities and the values of F . 

O 
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The significance of Carry-over, when allowance is made for all the 
other factors, including direct Treatment, as control factors may be made. 

It follows the same line as above when the reduction in sum of squares 
directly attributable to the Treatnients and. its slgnj.fioanGe were con- 
sidered. The matter is simply one of the order in which one forms the 
two lines as In Table SCVlIIo, l.e., the order in which one taies out 
the effects. Probably in a general practical way, it will not matter 
whether or no Carry— over is significaiit ^ it can be taken out anyhow just 
as we normally take out the effects of Rows and Columns regardless of their 
signlficanoe , On the other hand, if one wanted to test for the significance 
of Carry-over, per se , one would find the residual sum of squares on the 
Rows , Columns and Treatment and then find the Residual when all four factors 
are included. The question is then whether the reduction due to the intro- 
duction of Carry-over is significant. From a calculating point of view the 
matter is very simple, as can be seen from Table XXVIII- The variability 
residual on u * Rows, Columns and Treatments (control) has been previously 
calculated, as in JOarillb, in connection with the teat without Carry-over. 
The variability residual on the entire model has just been calculated in the 
test for Treatments with Carry-over in the model, as in Table XXVlIIc. In 
the present case Carry-over with F * 3.U7 is significant at the 5 % level. 
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Table XXXIII Youden rectangle, 11x5x11, illustrating Carry-over 
a. Satisfaction by Groups, V/eeka and Treatinents 



Week 



Group 


1 


1 




2 




3_ 




it. - 




5 


Sum 


I 


(1) 


82 


(2) 


68 


(4) 


70 


(7) 


78 


(11) 


81 


379 


II 


(2) 


74 


(3) 


65 


(5) 


65 


(8) 


65 


(1) 


75 


344 


III 


(3) 


74 


(4) 


57 


(6) 


54 


(9) 


•60 


(2) 


69 


314 


IV 


(4) 


82 


(5) 


70 


(7) 


72 


(10) 


71 


(3) 


82 


377 


V 


(5) 


76 


(6) 


68 


(8) 


64 


(11) 


68 


(4) 


71 


347 


VI 


(6) 


72 


(7) 


76 


(9) 


60 


(1) 


74 


(5) 


68 


350 


VII 


(7) 


79 


(8) 


57 


(10) 


58 


(2) 


75 


(6) 


72 


34i 


VIII 


(8) 


61 


(9) 


59 


(11) 


69 


(3) 


76 


(7) 


66 


331 


IX 


(9) 


68 


(10) 


51 


(1) 


69 


(4) 


80 


(8) 


65 


333 


3C 


(10) 


60 


(.11) 


66 


(a) 


55 


(5) 


60 


(9) 


66 


307 


XI 


(11) 


78 


(1) 


56 


(3) 


80 


(6) 


64 


(10) 


67 


345 


Siam 

Mean 


806 

73.3 


693 

63.0 


716 

65.1 


771 

70.1 




782 

71.1 


3768 
68 , 5 



Sum Sq. 59,63b 44,221 4?, 232 54,54? 55,946 
b. Analysis for direct Treatment alone 

(1) (i) (3) (4) (5) (6) (7) (8) (9) (10) (11) 
Contr. +1.32 +.91 +T.91 +2.2? -1.36 -2.l4 +3-50 -6.18 -3.l8 -7.64 +4.59 
AdJ.Mn. 69.83 69.42 76.42 70.78 67.13 66.37 72. 01 62.33 65,33 60.87 73.10 



Factors 


a.f . 


Residual Variability 
(Sqiiares ) 


y , Rows & Coluiims ( control ) 


4o 


1639.96 


Control factors plus Treatments 


30 


686.20 



•p - (1639.96 - 686.20)/10 _ j, 

^10,30 686.20/30 




K 



c. Direct Treatment and Carry-over estimates from simultaneous 



equations 

(i) (2) (3) (E) (i) (6) ih (8) (9) (10) (11) 

Contr. +1.86 +11. 70 +8.58 + 1.57 +.23 +1-25 -11.89 - 7.27 -11.62 + 2.15 

Adj. Mn. 71.95 70 . 3 T 80.21 77.09 70.08 68 . 7 ^ 69.76 56.62 61.2I+ 56.89 70.66 

[i] [21 T31 [k] [53 [6] f7i rs] [91 rioi rS] 

Contr. -.19 - 8.00 - 5.09 + 2.39 +^-57 + 9.87 +U -73 -.35 +I.98 -.70 - 9.02 
d * Significance of direct treatment effects 



Factors 


d.f . 


Residual Variability 
( Squares ) 


jj 5 Rows 3 Columns &Carrles-oTer (control) 


30 


1213.02 


Control factors plus Treatments 


20 


250.86 



F 

10,20 



(1213.02 - 250. 86) /lo 

250.86/20 



7.67*** 



e. significance of carry-over effecta 



Factors 


d.f . 


Residual Variability 
( Squares ) 


y 5 Rows 5 Columns & Treatments (control) 


30 


686 . 20 


Control factors plus Carries-over 


20 


250.86 



„ ^ ( 686.20 - 250 . 86)/10 . 

^ 10,20 - 250.86/20 - 
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f . Satisfaction “by Treatment and by •previous Treatment 



A crude ans 



Treatment 



.fter 


i ( 1 ) 

i 

\ 


( 2 ) 


(3) 


( 4 ) 


( 5 ) 


( 6 ) 


( 7 ) 


( 8 ) 


( 9 ) 


( 10 ) 


( 11 ) 1 


Smn 


Mean 


AdJ . 
Mean 


Contr 


( 1 ) 


] 


68 


80 


80 


68 














296 


74.0 


69.7 


+ 2.4 


( 2 ) 


1 

1 




65 


70 


60 


72 












267 


66 . B 


62.8 


- 4.5 


( 3 ) 


1 






57 


65 


64 


66 










252 


63.0 


59.9 


- 7.4 


(U) 










70 


54 


76 


65 








267 


66.8 


67.7 


+ .4 


( 5 ) 


i 










68 


72 


65 


66 






271 


67.6 


71.2 


+3.9 


( 6 ) 


1 












76 


64 


60 


67 




267 


66 . 8 


72.3 


+5.0 


( 7 ) 


i 














57 


60 


71 


81 ^ 


269 


67.2 


73.6 


+ 6.3 


( 8 ) 


! 75 
















59 


58 


68 ■ 


260 


65.0 


68.0 


+ .7 


( 9 ) 


i 


69 
















51 


69 i 


263 


65.8 


66.4 


-.9 


10 ) 


i 69 


75 


82 
















66 j 


292 


73.0 


69.2 


+1.9 


11 ) 


1 56 

J. - 


55 


76 


71 














; 


258 


64 .. 


59.5 


- 7 .C 


fc* gd. 


1 Q 2 

_ 


7 i 


71+ 


82 


76 


72 


79 


61 


68 


60 


T 

78 { 


806 








'jm 


i 356 


34 l 


377 


360 


339 


330 


371 


312 


313 


307 


362 ^ 


5768 








san 


! 71.2 


68.2 


75.4 


72.0 


67.8 


66. 0 


74.2 


62.4 


62.6 


61.4 


72 . 4 ; 






68.5 




ij •Mn, 


j 72 . U 


69.1 


77.0 


75.5 


69.6 


67.5 


73.8 


59.3 


59.4 


59.2 


70.81 










Diitr , 


■ + 3.9 


+ .6 


+8 * 5 


+7.0 


+ 1.1 


-1.0 


+5.3 


-9.2 


-9.1 


- 9.3 


+ 2 . 3 ' 











f 



f. 

I 

I 



I 



To the other calculations there has been added Tahle XKVIII'b which is 
a simple calculation of* the form previously recommended In connedtlon with 
latln squares, under certain circumstances. It Is not very suitahle here 
first hecause the iterative calculation is most extensive, as Is discussed 
in Chap. IX. Further, it can he seen from the comparison of the contrlhu- 
tions of Treatment and Carry-over with the truth of HVIIIc that the estimates 



are very had. This Is understandahle because not only are the two things 
hadly confounded, not only are they heavily confounded with Row effects out 



the effect of Treatment and Carry-over are pretty well confounded with the 
same row effects so that there must be a spurious positive correlation between 





them. 
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The estimates for Treatment and Carry-over, as in Table XXVIIIc, show, 
obviously, little correspondence. Their correlation coefficient is -,l4. 

As was said much earlier, in Chap. V, on the general problem of 
analysis, to the writer it seams generally of little interest to test 
the significance of Rows or Columns, Nonetheless, circu m st a nces govern 
cases and such may be useful. Accordingly, for this one problem such 
analysis will be made on the same general lines as for Treatments or 
Carries-over . This may be done conveniently in the model for direct 
Treatment above, l.e., without Carry-over, as in Table XXXIII b. The 
total equations are as in Equ. (li^9). To test for Rows it is necessary to 
drop from Equ, (1^9 ) the lines Involving . Nhen this simple set 

of equations is solved, together with the estimates of p. from Equ. (153) s 
and the resultant estimates applied to the rlght-h.ancl quantities of 
the equations 5 the sum of residual squares Is foimd. An operation 
such as that of Equ. (156) is involved. This quantity may be sub- 
tracted from the total variability as in Table XXXIIIb. The results 
are as follows : 



Factors 


d.f. 


Residual Variability 
(Squares ) 


y , Columns & Treatments (control) 


4o 


1400.28 


Control factors plus Rows 


30 


686,20 



p - : 1400,28 - 686.20 )/l0 , .p *« 

10.30 “ 686.20730 - 




21 ? 



Again, if one wished to test for th.. effect of Colimns , one would 
solve Eq^u, (149), making no allowance for the estimates of 3 , and 
make a calculation of residual variability like Equ. (156). The result 
would be 



Factors 


d.f . 


Residual Variabi.llty 
(Squares ) 


M , Rows & Treatments (control) 


3k 


li+99 . ''40 


Control factors plus Columns 


30 


686.20 



^ 4,30 



(1499.^0 - 666.20)/k 
686,20730 



8.89 



The attempt to extend such method to the model with Carry-over, 



as In .Table XXXIII d or e will encounter algebraic difficulty, 
because of tiie confounding of with Carry-over. 



Explicit 
squares , 



solution f or simpl e casei of Carry-over - In connection with latin 
it was suggested that explicit solution for the effect of Treatments 



and Carries-over , in terms of sums of observations, was not practical, and 
that it Is best to solve directly from least squares equations. It was, however, 
pointed out that the consideration of possible explicit solutions was useful 
in discovering whether a Design would yield certain estimates. There is a 



risk it will not when t is small. ..Actually, there is little temptation 
for men with algebraic ability to attempt an ejqjliclt solution of equations 
such as (i45). 




' 21,9 



5?18 



The smallest Youden rectangle, e 
■which is discussed in Chap. VIII since 
Yates Design is l+xSxU, i.e.t 



< t , is the Yates Design 3x2x3 
it is also a paired test,. The next 



Period 



Group 




1 




2 




3 


I 


(1) 


yni 


(3) 


71231 


(h) 


71343 


II 


(2) 


7212 


(i+) 


72242 


(1) 


72314 


III 


(3) 


731" 


(1) 


73213 


(2) 


73321 


IV 


(k) 


7414 


(2) 


74224 


(3) 


74332 



It is possible to solve for Row, Column, Treatment and Carry-over effects 
since there are 12 parameters: 



y 

Groups 

Periods 

to be discovered from 12 
determined. There is no 



1 

3 Treatments 3 

2 Carrles-over 3 

observations , The situation 

over-determination available 



Is, Indeed, exactly 
for the estimation of 



extraneous variability and such is the essence of statistics. The Design 
can, of co’jrse, be repeated, say once, and then there become available 8 
degrees of freedom for the estimation of extraneous variability. Obviously, 
for all Yates rectangles, tx(t-l)xt, t>l,lt must be possible 
to distinguish the Carry-over from the Treatments proper. Repetition of the 
Design may be necessary to get an adequate number of degrees of freedom. 

Apart from the Yates rectangles , in the smallest Youden Design 



7x3x7, 




Period 



Group 




1 




2 




3 


I 


(1) 


7111 


(2) 

(3) 


71221 


(4) 


71342 


II 


(2) 


7212 


72232 


(5) 


72353 


III 


(3) 


7313 


(if) 


73243 


(6) 

(7) 


73364 


IV 


(if) 


7414 


(5) 


74254 


74375 


V 


(5) 


7515 


(6) 


75265 


(1) 


75316 


VI 


(6) 


7616 


(7) 


76276 


(2) 


76327 


VII 


(7) 


7717 


(1) 


7^^217 


(3) 


77331 
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it is possible to solve for column^ treatment, and carry-over effects 

since there are 21 parameters to be found from 21 observations - The solution 
Is again mathematical rather than a statistical matter of true least squares 
estimation. In all the higher Youden rectangles there are enough observa* 
tions in the pattern to make it possible to estimate Carry-over independent 
of Treatment, proper, and vice versa . Repetition of the Design may be neces- 
sary to get an adequate number of degrees of freedom. 

Youden rectangles with missing Rows As was previously observed in con- 
nection with latin squares, under the practical conditions of experimentation 
it is very common, indeed almost usual, for there to be some data missing. 

It is very common. Indeed almost usual, for there to be some data missing 
from a Youden Design of almost any type. Entire Rows missing, is much more 
common than single observations missing. Accordingly, it becomes not a 
matter of dealing with a table where here and there an observation Is 
missing but of dealing with a Design where 2 of the 19 Rows are mlsaing and 
so the balance of the experiment is much disturbed. The praotleal situation 

is actually worse than is coirmionly pictured in the literature, when an observa- 
tion Is supposed lost here and there. Under practical conditions, as was 
previously in connection with the latin square, one is not only 
disappointed in a Machine’s or a Man’s not completing his assignment but in 
fact of, 9 19 Machines, aesigned, 2 do not appear at all; they are withdrawn 
for other purposes. One man fails to complete assignment of Changes—over . 

The effect, for a Youden rectangle, is much more serious than for a latin square 
where a whole Row is missing, because there every Row contains every Treatment. 
In the youden rectangle as soon as a Row Is lost , the balance of Treatments 
is upset. 
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A situation with two arhitrarily chosen Rows missing is shown In 
Table XXIX^ derived from Table XXVIII • Even if there be only interest In 
the simple model with direct treatment effect and no Carry-overs 1^ seems 
hardly practical to do ai^rthlng but use the least squares equations or a 
program in an electric ccmputer Involving them- If we write out the equa-» 
tions a great many will be modified by the Inccmpleteness of the Design. 

In the program shown in the Appendix^ note that there need be given no indica- 
tion of how the data are incomplete--lndeed5 the Rows may be renumbered. 
Regardless of method^ the I'esults are as shown in Table XXIXc - 

The disturbance In the situation may be appreciated by considering 
briefly the least sq-uiarea equations for Table XXIX* Let us restrict 
ourselves 3 for the moments to the model with . only direct Treatment 
effects, l.e., without Carry-over. Now forin the estimate of li from the 
sum of all ohservations , l.e,, 

Ujy + 4 (aj + otj + otg + a4 + ag + ote + ct7 + ttg + ag) + 9 (Si + B2 + S3 + S4 ) 

+ Uyi + 4y2 + ^Y3 + 5Y4 + 5YS + 3Ys + ^Y? + ^Ys + 5Y9 + 3 YiO + ^Y 1 1 




hut taking advantage of the zero-centering of results, i.e., Equ. ( 9) 

and (135) 

U5y + Y4 + Ys ~ Y6 + Y9 “ Yio ^ 3768 ( 158 ) 

the moral of which Is that one ' s estimate of the general level depends on 
what Treatments occur frequently and what occur Infrequently. The 
practical thought is that the equations are going to he a lot more 
difficult than In the perfect and complete Youden rectangles. 
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Not only is y confounded in some measure with treatment effects but so 



are the quantities 



which accordingly became involved in the general 



system of simultaneous equations— they no longer come from their own 
independent set of equations as previously in Equ. (li+4). All the above is 
true when only direct treatment effects are Involved. Nhen Carry-over is 
3'lso adniltted it much contributes to the confounding and complexity. The 



total situation is shown in matrix form in Equ. (139) which may be compared 
with Equ. (l45). The situation tends to be Intolerable for direct handling-. 
It should be under stood, but it is best left if possible to the electronic 
computer as in the appendix program. The full matrix is: 



I 

■i 

I 

>. 

{ 

f 



f 

I 





o\ 

u\ 
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CO 

II 



< tq 

C 3 



Ol 



CD 

< 60 



< 60 



< to 



m 

< 60 



€ 60 



m 

6 60 



csl 

< ^ 



< ^ 
o 






II (I il II II 11 

rS 



\D ITS ir\\o ■ cn cvj oj' rn H in' Rj' 

ii II H II II II II II it It fj II fi II II II II 



OJ 

ii II 



6 j 

II 



H O Cu CU 
t-“ O pH O 
OJ C\j CM 



(‘n 

OJ 



N- 

rH O 
CM 



II II II II II it n 



rH i=H 
iH 



i — I i~i 



< ^ 



< 



CO 

< ^ 



< 



< 



< 



6 

cn 

< 

CN 

< ^ 



tn 
< QQ. 



< ca 



fO 

< oa 



CM 
< QQ 



< ^ 

< a 

CD 

< a 

< d 

< d 
« d 

< d 

CO 

< d 



CM 

< O 

ERIC 



fH fH f— I 
i — I pH rH 
pH pH rH 
fH fH 



I 



rH 

rH rH 
rH 



m 



cn 



on 



*H jH rH pH 
pH rH iH pH 



m 



on 



iH 

! 



on fH 



Lm 



pH rH <H 



»H fH iH fH 



on 



ITS 



trs 



rH rH rH rH 



fH fH 



rH 

I 



On ^ 



iH 

I 



On 



ON 



pH rH 

I 



ON 



I lilt I I I t I 



pH iH 



rH 



Lf\ 



LTN 



fH rH fH 
fH H 



Lf% 



ITS 



LTN 



fH H H 
H fH fH ^ 
rH rH H 



fH pH 



H 



H 



224 



(The positions left empty contain zeroes, not shown) 



In order to make the analysis, as in Table XXIXb for the mouel with 
Treatment effects only, it is first necessary, as usual, to find the 
variability residual on the control factors \i , Row and Column. This is 
very easily done, since they are orthogonal. It may be done by analysis 
of variance techniques or by neglecting the elements of Treatment and 

^ A 

Carry-over, l.e., the coliomns (l 8 th through 39 th), involving y_ and 6 
of Equ. (159) and the corresponding rows. In the latter case the resultant 
estimates are: 



U = 68.h9 

oti ct2 «3 «4 ag 0-6 “7 olq ag 



+7.31 +.31 -5.69 +6.91 +.91 +1.51 -2.29 -1.89 -7.09 



( 160 ) 



3 l P2 03 04 05 

+3.62 - 4 . 0 k -4.27 +1.73 +2,96 



The residual Is found, as usual, by taking from 213,708 the sum of products 
of these estimates times the appropriate right-hand constants of Equ. ( 159 ) 
to give 1111.20 as shown in Table XXlXa. In order to find the further 
reduction due to Treatments it is necessary to consider Equ. (l 59 ) less 
the 29th through 39 th columns and the corresponding rows . The resultant 
estimates are: 



y * 68.31 



ai 



a2 



«3 



«4 



ai 



at 



0.' 



OLi 



ag 



ERIC 



+4.55 -,20-6.27 +6.99 + 1.29 +1.32 -3.10 +.54 -5.11 

A /i, 

01 02 03 04 05 

+ 4.68 -3.98 - 4.51 +1.£ +1.98 



j 
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and estimates of Yj^ or (k) , as shown in Table XXI>Cb. The residual is 
found j as usual, by taking from 213*708 the sxim of products of these 
estimates times the appropriate right-hand constants of Iqu, (l 59 ) to 
give 454. These results are summarized in Table XJCCXb. 

In order to test the significance of Treatments, as in Table XXlXc , 
for the model with allowance for Carry-over, it is, of course, first 
necessary to find the variability residual on the control factors , y , 

Row, Column and Carry-over; it is necessary to use Eq_u. ( 159 ) with Treat- 
ments dropped. This, probably, by setting all y at zero. The resultant 

A 

estimates are: 



u ® 68,54 



1 



01 Q2 ^3 «4 “5 «6 «7 as “9 

+8.82 +1.25 -5.09 +6.65 +.45 +1.82 - 2 .i 4 -3.06 -8.70 

^ ^ A ^ A 

Si @2 S3 S4 $5 

+3.57-^.30-4.39+2.30+2.83 ■ (I62) 



^2 ^3 ^4 55 fie fi? 5 s fig fiio fill 

+.66 -1.86 -1.92 -2.73 +.19 +1.20 -3.88 -1.33 +.22 +7.45 +2.01 

i ■ 

The residual is found, as usual, by taking froni 213 , 7 o 8 the sum of products 
of these estimates times the appropriate right-hand constants of Eq,u. ( 159 ) 



to give 



69. In order to find the further reduction due to Treatments 







H 
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it is necessary to consider the full model, with all factors, of Equ. ( 159 ). 
The resultant estimates are: 



a 



“2 



a ■ 



U = 67.88 



04 



a I 



06 



07 



08 



+5.51 +1.19 -10.16 +1.40 

Bi Bo 



'51 -1.33 +2.27 +2.13 
S4 @5 



-.51 



+^.31 -4.44 -4. 06 +2.0'^ f-2.15 



(163) 



nd estimates of or (k) and 6 ^ or [£] as shown in Table XXIXc . 

The residual is found, as usual, by takins from 213,706 the sum of products 
these estimates times the appropriate right-hand constants of Equ. ( 159 ) 
to give 136,58. These results are summarized in Table XXIXc. There, there 
are shown tests of significance for both Treatments and Carries-over . 

The Design and data may be simply fed into an appropriate program, 
as in the Appendix of this book and the complete analysis will be done. 

This last alternative is much the most in the api: It of these casual latter 
days, but it still seems wise to have some idea of what is going on. 
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Table XXIX , - Youden rectangle vlth 2 mlsBed lines 
a. Data 



Week 



Group 




1 






3 


4 




5 


Sum 


I 


(1) 


82 


(2) 


68 


(4) 70 


(7) 78 


( 11 ) 81 


379 


11 


(2) 


74 


(3) 


65 


(5) 65 


( 8 ) 65 


(1) 


75 


344 


III 


(3) 


74 


(4) 


57 


(6) 54 


( 9 ) 60 


(2) 


69 


314 


IV 


(4) 


82 


(5) 


70 


(7) 72 


( 10 ) 71 


(3) 


82 


377 


V 


(5) 


76 


(6) 


68 


•(8) 64 


( 11 ) 68 


(4) 


71 


347 


VI 


(6) 


72 


(7) 


76 


(9) 60 


( 1 ) 74 


(5) 


68 


350 


VII 


(8) 


61 


(9) 


59 


(11) 69 


(3) 76 


(7) 


66 


331 


VIII 


(9) 


68 


(10) 


51 


(1) 69 


(4) 80 


(8) 


65 


333 


IX 


(10 


) 60 


(11) 


66 


(2) 55 


( 5 ) 60 


(9) 


66 


307 


Sijm 




649 


580 


578 


632 




643 


3082 






Ana ly 


sis ft; 


?r direct Treatment alone 
























^ /S 


„(1) _ 




(i) 




(6) ^(7) _ 


(8) 


(9) (10) 


Contr. +4.15 


+.4l +5*^6 


+2. 


27 -1.36 


-1.15 +3 


.42 - 


5.18 


3.18 - 9.29 


AdJ. m. 72.46 68.72 


73.77 


70. 


58 66.95 


67.16 71 


.73 63.13 65.13 59.02 



Pact or a 


d.f . 


Residual Variability 
(Scuares) 


y s Rows & Columns (control) 


32 


1111.20 


Control factors plus Treatments 


22 


454.76 



P 

10,22 



(1111.20 - ^54. 76) /IQ 

k3k. 76/22 



3.18» 



O 

ERIC 



,-228 



/N 

-Liil 

+U.1e6 

T2.TT 
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c. Analysis for direct Treatment and Carry-over 



(1) (2) (3) (i) (5) (6) (7) (8) (9) (10) (ll) 

Contr. +3.19 +2.72 +11.66 +10.i+9 +3.68 -.19 +1.16 -11.08 -8.78 -12.37 ~.h 6 

AdJ.Mn. 71.07 70.60 79.54 78.37 71.56 67.69 69.04 56.80 59.10 55.51 67.42 



[1] [23 [3] [4] [5] [6] [7] [8] [9] [10] [n] 



Contr , 



•3.53 -iLl +0 -5.97 + 1.84 +5.28 +11.18 +8.09 +.58+2.45 +.77 -9.29 



Factors 



u 3 Rows 5 Coluains & Carries-ovei" 
Control factors plus Treatments 



jd.f . 

i 

_ — I 

(contro2)| 22 

I 



‘Residual Variability 
(Squares ) 

867.69 

136.58 



F = (867.69 - 136.58)/10 

10 3 12 136.58/12 



6 , 42 ** 



Paetors 


d, f . 


Residual Variability 
(Squares ) 


P 5 Rows 5 ColuBins & Treatments (control) I 


1 22 

1 


- - V- ■ i ^ 

454.76 


1 

Control factors plus Carrles-over 
^ 


u 


136.58 



r 

10,12 



(U54.76 - 1.56.58)/10 
136.58/12 



2.80* 
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In this situation of a Youden rectangle, c < t , the missing values 

^ A 

disturb the adjusted mean, y,. + y a from that gotten in Table XXVIII 
regardless of ■whether a given Treatment is missing or no. The situation 
differs from that obtaining for a latln square, as is discussed in con- 
nection with Table XXIX, The comparison of the results in Table XXlX 
with those from the full data of Table XXVIII show them to be much the 
same. The position we must necessarily take is that imperfect design 
must be accepted and can be handled very well, in a practical way. From 
this emerges a point, that we need not be too strict in design. Such 
possibilities are explored brlefj^ in Chap. VIII. 

Youden rectangles with missing cells — A situation with two arbitrarily 
chosen observations missing is shown in Table XXX , derived from Table 
XXVIII, Note that in Table XXX the entire Design, which was intended, is 
given, l.e.. Treatment is given for the missing data cells. This assumes 
that the Treatment (8) or (10), as the case may be, was administered 
so that there will be a Carry-over if any subsequent Treatment was tried. 
Only the actual observation is missing. The situation Is Just the same 
as for the case of missing cells discussed in connection with latln 

squares. If such was not in fact the case, the resultant least squares 
equations would be a little modified. Allowance would have to be made for 
the fact that the cell following the miss would contain no C^ry— over . 

Following previoxi'’ lines, it is possible to set the least squares equations 
up as in Equ. (l6it) j The equations are, of course, the same as Equ. (152) 
for the complete data except for y Rows VII and XI, Columns 2 and 5» 
Treatments (8) and (lO) and Carrles-over [6] and [?]• The least squares 
equations are as follows j 




36kk 



il6h) 
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mnnc^cnrnmcNjrnfnno odv^d rnmcncncn^nonojoncu c\jc^ojc^ojcuajcyojoj 



I) II II II II II (I II II II II 



II II ii 11 II II II II II II II 



II li Ii II il II II Ii ii 



II II il 



vn 



rH rH fH 

I I 



! — I I — I rH 



•H rH rH 



fH 

I — I 

ITS H 
HT rH 






rH rH rH fH 

H H H M 
rH rH fH H rH 

»H rH rH f— I 

rH H iH fH 

fH fH H . H 



fH H H I — I 



Hi — I fH 



ifs 



H H 



LTN 



H rH 
H 

O H 



HHHi — IHi — IrHi — iiHi — I 

I I I I i I I I I I 



H H 



H 

tJ% iH 

LfN H 



H H H 

I — I I — I H 



LfN 



H H H 



LT\ 



H H H 



LTN 



O 

ERIC 



.H" 



H H 



1 =^ pH 
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(The positions left empty contain zeroes, not s'hovm) 
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First there must be considered the model, cut back to the lowest 

level, i.e., with only the control factors y , Rows and Columns, and even 

they are no longer orthogonal. The elements of Treatment and Carry-over 

will be neglected, i.e., the columns (l8th through 39th), involving y 
« k 

and 6^ of Equ, ( 16 U) and the corresponding rows must be dropped. The 
resultant estimates are: 



y - 68.76 



“2 “3 “4 “5 as “7 ag ag otj^g 



+7.04 +.oi* -5.96 +6, 6k +.64 + 1.24 +.97 -2.56 -2.16 -7.36 + 1.46 " 

A A 

81 82 03 84 05 

+4.51 -5.06 -3.67 +1.33+2.89 j 

It now is necessary to find the residual squares on estimateB of y , 
and Columns as control factors, which is; 



( 165 ) 



Rows 



253,838 - 68 . 76 ( 3644 ) 

- { + 7 . 04 ( 379 ) + . 04 ( 344 ) - ... + 1.46(278)} 

- { + 4.51(806) - 5.06(636) - ... + 2.89(715)} 

= 1568.38 (pggj 

if the thing be carried out with accuracy, of the estimates to the fourth 
decimal place. It would have been Impossible to use analysis of variance 
techniques . In order to find the further reduction due to Treatments it 
is necessary to consider Equ. (l 64 ) less the 29th through 39 th columns 
and the eorresponding rows. The resultant estimates are: 
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u = 68.45 

'' 

tX3 a4 as ag aj ag ag aip an 

+ 4 .TT -.41 -6.86 + 6.29 +1.28 +1.86 +3.06 -3.82 +.93 -5.44 -1.67 f 

^ A « ^ ^ 

61 @2 @3 61+ 05 

+ 4 ,. 83 -3.09 -3.36 + 1.64 +1.91 



(167) 



and estimates of or (k) , as shown in Table XXTb. The residual is 

found, as usual, by taking from 253,838 the sum of products of these 
estimates times the appropriate right-hand constants of Eq.u. (164) to 
give 650.93. These results are summarized in Table XXXb, 

Next there must be considered the model with only the control factcrs 
M , Rows, Colmms and Carrles-over . The columns (l8th through 28th) 
involving and corresponding rows of Equ, (l64) must be dropped. 

The resultant estimates are: 



y — 68.72 

“1 ^^2 «3 35 cig ay aa ag 2^0 an 

+7.20 +1.73 -5.28 +6.27 +1.30 +.34 +.27 -.95 -4,33 -8.15 +1.60 

^ ^ ^ 

61 $2 03 04 65 

+4.55 -5.39 -3.63 +1.37 +3.11 

61 62 <53 64 65 6g 67 63 69 610 fill 

+5.21 -1.10 -3.86 -1.80 -.12 +1.71 -2.94 -3.17 +.71 +6,90 -1.54 



(168) 



The residual is found, as usual, by taking from 253,838 the sum of products 
of these estimates times the appropriate right-hand constants of Equ. (l64) 
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to give 1171.90. In order to find the further reduction due to Treatments 
it is necessary to consider the full model, with all factors, of Equ. ( 164 ). 
The resultant estimates are; 

n = 68.77 

®1 ^2 ^3 0^4 “5 »s “7 0^8 “9 “10 “11 

+3.88 +.53 -11.15 +1.29 “1.02 - 2.57 +5.98 +1.37 ■H.I9 -1.09 +1.60 ^ 

^ A 

01 02 03 04 05 

+U .50 -4.96 -3.68 +1.32 +2.81 



and estimates of v, or 

k 

The residual is foimd, as 



(k) and 6 ^ or [£,] , as shown in Table XXXc. 
usual, by taking from 253*838 the sum of products 



of these estimates times the appropriate right-hand constants of Eq_u. (l 64 ) 
to give 207.66. These results are summarized in Table XXX'e. There, there 
are shown tests of significance for both Treatments and Carries— over . 

Unfortunately, one cannot, as for previous problems, in practice avoid 
the effort required to set up the foregoing equations by having an electronic 
computer do so, after it has been given the Design and the data, in the 
electronle progrMi of the Appendix. The problem is discussed there. Briefly, 
the program would have to be extended. 
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Table XXX - Youden rectangle -with 2 missed observations 
a. Data 



Week 



Group 




1 




2 




3 




4 




5 


Sum 


I 


(1) 


82 


(2) 


68 


(4) 


70 


(7) 


78 


(11) 


81 


379 


II 


(2) 


74 


(3) 


65 


(5) 


65 


(8) 


65 


(1) 


75 


344 


III 


(3) 


74 


(4) 


57 


(6) 


54 


(9) 


60 


(2) 


69 


31 4 


IV 


(4) 


02 


(5) 


70 


(7) 


72 


(10) 


71 


(3) 


82 


377 


V 


(5) 


76 


(6) 


68 


(8) 


64 


(11) 


68 


(4) 


T1 


347 


VI 


(6) 


72 


(7) 


76 


(9) 


60 


(1) 


74 


(5) 


68 


350 


VII 


(7) 


79 


(8) 


NR 


(10) 


58 


(2) 


75 


(6) 


72 


284 


VIII 


(8) 


61 


(9) 


59 


(11) 


69 


(3) 


76 


(7) 


66 


331 


IX 


(9) 


68 


(10) 


51 


(1. 


69 


(4) 


80 


(8) 


65 


333‘ 


X 


(10) 


60 


(11) 


66 


(2) 


55 


(5) 


60 


(9) 


66 


307 


XI 


(11) 


78 


(1) 


56 


(3) 


80 


(6) 


64 


(10) 


NR 


278 


Sum 




806 




636 




716 




771 




715 . 


3644 



Contr , 
AdJ .Mn, 



‘b. Analysis for direct Treatment alone 
(i) (i) (3) ih) 



(i) (6) (T) (8) (9) (m) 

+ .73 +8.25 +2.2? -1.36 -1.98 +3.32 -3.18 -9.16 +4.93 



( 11 ) 



+ 1, 66 

70.11 69.18 76.70 70.72 67.09 66.47 71. T7 62.99 65.27 59.29 73.38 



Factors 



y , Rows & Columns (control) 
Control factors plus Treatments 




Residual Variability 
( Squares ) 



1568.38 

650.93 



10,28 



(1568.38 - 650.93 )/10 
650.93/28 



O 

ERIC 
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G. Analysis for direct Treatment and Carry-ove r 

^ ( 3 ) (il- ( 3 ) ( 6 ) ( 7 ) ( 8 ) ^ 9 ) ( 10 ) fll) 

Contr. + 3.31 + 1.83 + 12.31 + 9.82 +2.56 +.40 +.97 - 11.40 - 8.43 - 12.33 +.96 
AdJ.Mn. T 2.08 70.60 81.08 78.59 71-33 69.17 & 9 . 1 k 57.37 60.34 56.44 69.73 



Contr . 



-ji] La] [33 [ 4 ] [j] [61 \h 

-1.30 -9.49 -6.17 +2.17 +4.80 +11.54 +7.48 



[ 8 ] 



-.23 +2.45 -1.09 -10.17 



Factors 


d,f . 


i Residual Varlahillty 
i (Squares) 


M , Row, Columns & Carries— over 


(control) 


28 


1171.90 


Control factors plus Treatments 




18 

1 


207.66 



10 j 18 



,90 - 207 . 66 ) /lO 

207.66/16 



FactorB 



p , Rows 5 Columns & Treatments (control) 
Control factors plus Carrles-over 



IP ^ (650.93 - 207 . 66)/10 

10,18 207.66718 



= 8.36*w* 

, „ I Residual Variability 
‘ ‘ : ( Squares ) 

I 

28 i 650.93 

18 ! 207.66 

I 



3 . 84 ^* 



In this situation of a Youden rectangle, c < t , the missing values 
distiirb the adjusted mean, + U » from that gotten in Table JOCVIII 

regardless of whether a given. Treatment is missing or no. The situation 
differs frean that obtaining for a latln square, as is discussed in connection 
with Table XXIX. The comparison of the results in Table HOC with those 
from the full data of Table JQC 7 II 1 shows them to be very much the same, 
as might be expected because the data are very much so. 
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VII » Analysis of data from vaxlous special kinds of Youden 

' Page 

Special Youden Designs 236 

Double Youden, t x c x 2t 238 

Paired Youdens , 2(t*xoxt) Zh'J 

Repea'fced Youdens 252 

Missing data situations 259 

Designs more or less Youden 266 

Breaking Treatment variability up . 275 

Design with several sections . ..... 28l 
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Special Youden Designs - The discussion of analysis 5 so far, has been a 
detailed one for the cases of the latln sq^uare and the single basic Youden 
rectangle -with c < t and r - t . The only serious practical complication 
has been that a Design may be incomplete by somre Rows. In order to deal 
with the Youdens generally it is necessary to consider, in some detail, 
extensions, beyond this realm. First, there are Designs, already indicated, 
where the number of Rows, some multiple of t , the numher of Treatments 
but the fill is an integer and c ^ t . Secondly, there are two outlying 
types of design. 

The Designs with number of Rows, some multiple of t ^ are of 3 typ' s: 

a. Multiple Youdens where the number of Rows necessary to get integer 

fill is 




For this type, a number of Designs were shown in Table XVIII, i.e., cases 
where g - 2 . There, of course, exist more cases where g > 2 is some 
integer. Here we consider only double Youdens, except for paired comparisons 
in Chap. VIII on that subject. This t 3 rpe of Design arises only for 

c < t } there is, of course, no analogy in the case of the latin squares 
where the fill is always t . 

b. Balanced Youdens where the number of Youdens necessary to get all 
t - 1 Treatments preceding (or for that matter following) a given Treatment 
requires gt Rows although each successive t Rows is a true Youden (with 
Integer fill) and with unrepeated Change-over, in its own right. Some 
Designs of this type are shown in Table XVII . Here we consider only paired, 




g = 2 



9 



g > 2 



is BOine Integer, 



cases. Of course, there can exist cases 'where 



This type of Design arises only for c < t . When c = t , In the latin 
square, if a Design can be written with unrepeated Change-over, it is 
necessarily balanced. 

c. Various repeated Designs are very conunonly used. Thus each 
successive t Rows may be a repetition of the same single Youden. It may 
also be a latin quare repeated. In practice g is often some number of 
magnitude 5- It seems most practical to make a simple repetition although 
the literature contains examples where a succession of Designs is used, 
that Is, each t Row is a fresh Youden in its own right. Such richness 

may delight the professional statistician but must dismay the practical 
experimentalist. It may be practical to repeat the double Youdens , the 
paired Youdens , as above . 

miBn, however, it comes to more complicated matters like finding the 
^^Snif icance of treatment effects (even without allowance for Carry— over), 
it will be assiamed that the reader have an electronic ccmiputer available and 
that he will use least squares equations, as In previous dlacjisslon, in some 
way. He may simply feed in the Design and the resiilts if circumstances are 
f avorable e To set forth esq^licit statements such as were put out for the 
single unrepeated Youden Is Intolerable. Of course, when Carry-over is 
Indeed similar equipment and policy are assumed. 

An odd Design which may be termed the near-Youden will be presented 
and discussed, A common practical situation where an es^erlment is done 
in several blocks will be indicated but not fully treated. 
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Double Youden, t x c x 2t ~ Consider first the double Youden, t x c x 2t . 

Such an exajnple is presented in Table JQCXlj -which is concerned with 

satisfaction reported by l8 Men on each of some 4 Treatments that each was put 

under successively. It is a 9xi^xl8. For such multiple , balanced or repeated 
Youden s , the total fill or number of times that the comparison table is 

filled, in the sense of Equ. (2), is 



f = gc ( c - 1 ) / Ct - 1 ) . ( 3 ?1 ) 

Consider next the estimation of direct treatment effects. The 

underlying assumptions are the same as those for a single Youden, t x c x t , 
with which we started the consideration of analysis of data. The estimate 
of the effect of the Treatment is 



where y is any observations \mder Treatment k and where T. is the 

ijk 

sum, of observations for any Row in -irhlch k occurs • This is all very 
much as in Equ. (112) for one single Youden 'except that the observations 



y -under k occur gc rather than c times. The same statements 

ijk 

may be made for balanced and repeated Youdens . Generally , it is impossible 
to reverse the roles of Rows and Treatments , as was done for single Youdens , 



so that there are no easily calculated estimates of Row effects. 

For double Youdens it is impractical to put in a 0 conditioning 
Period of the type that is sometimes used with latin squares. It is even 
less practical than for a single Youden where it does little good. For 
double Youdens such a step would mean that a given Treatment had its own 
Carry-over twice associated with it whereas such other Carries— over as ai e 
associa'ted b.tb so tuti once* 
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The estimate for Treatment (l ) , directly, -without allo-wance for Carry- 
over, following Equ. (l7I) and (1T2) is 



Yi or (l) 



^(yiii + y 22 i +••*'•^731 y84i) ~ + T2 +...+ T 3 ) 

- 27, 



= [ 4 { 2 . 5+2 . 1+2 . 1+1 . 6+1 . T+2 . 3+2 . 1+2 . 1 } 

- { 12 . 5+10 . 1+9 . 5+T . 8+7 • 3+10 . 9+10 . 6+10 .2}] /2J 

= - .48 (IT 3 ) 



In order to get the effect of Treatment or Material (l), from Equ. (I 29 ), 

we take 4 times the results at (l) at each of the 8 occaBions when it 

occurs less the suni for each of the 8 Rows in which it occurs all divided 

“by 27 to get estimates as are shown in Table XXXrb , This quantity 

may be called the treatment contribution, i.e., the amount that 

the Treatment differs from the average of all Treatments. To this 

each such quantity there may be added y - 2.57 to give what may he 

referred to as the adjusted mean which is often a convenient practical 



form in which to report effect of Treatments. 



The business of analysis again involves 



equations for the effects, y 



a . 

1 




setting up least squares 

Y, and 6. appropriate for 

JC » 



vau’ious levels of the models of Equ. (T) and Equ. (43) and finding the 



Variability variously residual. The handiest thing to do seems to be to 
set up the full equations, as in Equ. (48), previously, and then cut back 
to the lesser situations _hy Judiciously dropping rows and columns . Examin- 
ing Table XXXIa, it is at once apparent that the grand total 1958.88 
contains all effects of Rows, Columns, Treatments and Carries-over equally, 
so that we may write the first line of the grand set of Equ. (175 )• When 




■ } 
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it conies to estimating the effect of Rows, it is necessary to recognize 
that their totals contain no effect of Column, In the sense that they 
contain them all equally and remembering Equ. ( 9 ) • "tlie other hand the 

total for Row contains much effect of Treatment. Thus for Row, or Man I, 
there are present Treatments (l) , (2), (4) and (8). It would be mischievous 
to convert this statement into one that it lack Treatments (3), ( 5)3 (6) and 
( 7 ). The total for Row I must also contain 3 Carrles-nver , Thus there may 
be written the second line of Equ, (175). Others may be ■written likewise, 
as shown in the following lines. In the IJth line the corresponding statement 
is not made but rather there is, again, an appeal to the condition of Equ. ( 9 ), 
to avoid the algebraic problem of singularity, if Equ. (l45) a3:*e treated as 
a set of simultaneous equations. For Coliamns and equations are: 



l8gi + l8p = 46.7 

18B2 + l8p = 45.3 

1863 + l8u = 46.0 

@1 + 82 + 63 + S4 = 0 

These are not included In Equ, (l75 ) because it is somewhat bullqr anyhow. 

Treatments and Carries-over are extensively and Intimately confounded with 
each other and with Rows, as set forth in Equ. (l75). In addition Inhere is 
the peculiarity that each Carry-over is confounded with Column^ 1, although 
it is free of them! We have: 



(174) 
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(1T5). 



24l 



m 

ii 



< 



< ^ 



< 



< ^ 



cn 

< >- 



OJ 

< >- 



< >- 



< ca 

CO 



< 


a 










< 


a 






< 


a 




i/> 




f— t 


< 


« 








t — 1 


< 


a 








r — 1 


< 


a 




CM 






< 


a 




■ 1 






< 


a 




a 




m ~i 


< 


a 






■ < 


a 




CO 


€ 


a 






< 


a 




CP 


c 


a 




LO 


< 


a 








a - 




cn 


< 


a 



^ rH rnoo LTsoc^co onococo 0\ ^ co kd o t^Lrsco COgo t— ^ ojoo o nnoo ^ iH trs qs ^ oj o 

^cwoqodc^Ho^cn^^^-^^dHdoJo^d 

COiHHH H M HHHH H 



HLTnHON^ 

-^HC\JHCUHC\JH 



cn 

OJ 



LTN\D Ln^ LncnirNLTN 
I — liHfHrHrHrHiHi — I 



■I II II II II II II II II II II II II II II II II II II II II II II II 



II II II II II II II II II II II II 



m 

< ^ 










rH 




rH 


H 






H 






rH 




rH 


rH 




rH 


rH 


rH 


1 — ! 




















rH 


00 
< to 










fH 


rH 


rH 






rH 






iH 




rH 


H 




H 


rH 


rH 




H 


















VD 


rH 


< <0 








rH 


rH 


iH 






iH 






H 




H 






rH 


rH 


H 




rH 


H 
















VD 




rH 


CP 
< tQ 






rH 




rH tH 






rH 






rH 




iH 






rH 


rH 


iH 




rH 




1 

1 














VD 






1 — 1 


in 

€ 60 




iH 




rH 


H 










rH 




fH 








rH 


rH 




fH 




rH 


rH 












VD 








rH 


< 60 


1 — 1 




iH 


1 — 1 










fH 




fH 








rH 


fH 




H 




rH 


H 


1 — ! 










VD 










rH 


rn 
< to 




rH 


1 — 1 










rH rH 




1 — 1 








1 — I 






iH 




rH 


rH 




rH rH 




















rH 


CM 
< to 


1 — 1 


H 










rH 




rH 








t — I 






1 — 1 




1 — I 


rH 




1 — 1 


I 

I 






VD 














H 


c to 


fH 










H 




rH rH 








rH 






rH 




1 — I 


1 — I 




rH 


1 — ! 


1 — 1 




VD 
















fH 


< ^ 




rH 






1 — 1 




fH 


1 — 1 






rH 






rH 


H 
















rH 


1 — ! 




rH 


rH 


rH 




iH 


! — 1 




CD 
c ^ 


rH 








rH 


rH 


rH 






rH 






rH 


rH 


1 — I 














oO 


rH 




fH 


rH 


rH 




1 — ! 


! — I 







rH rH 



CO 



« — ! rH I — I 



CD 



iH H 
H rH 
rH rH 
rH 



GO 



rH rH rH iH iH iH rH 
H H H H iH H 
pH I — I iH I — ! I — ! fH 



rH rH M 
t — It — I iH I — ! 



I — I 






rH 


GO 




rH 


rH 


H 


rH fH 1 — ! 


GO 




f — ! 


H H 


rH 


fH rH 1 — 1 


CO 






f — ! 


iH 


H 


1 

,1 

1 


pH CO 






f — ! 


f — I 


1 — ! 


rH rH rH 


00 








OJ OJ 


OJ CM 


OJ CM OJ OJ 


H 








1 1 


1 1 


1 1 1 i 


fH rH f — 1 


rH 






f — ! 




H 


f — 1 f — 1 


iH 


fH 




rH 


rH 


f — 1 


H rH 




I — i I — j 






rH 


rH 


rH f — ! 


fH 


1 

1 




rH 




1 

1 


rH rH 


I 

I 


rH 




fH 




rH fH 


rH 


rH fH iH 








rH 


H 


rH rH 


rH rH 








fH 


rH rH 


rH rH rH 


rH 


fH 




iH 


rH 


fH 


fH fH rH pH 


fH 






H 


rH 


rH 


iH iH rH 




rH 




rH 


f — I 




rH rH 


1 — ! 


1 — ! 




rH 




rH 


fH rH 


iH 


fH rH 




iH 




rH fH 


iH 


H H 


rH 








1 — 1 f — 1 


fH rH 


rH rH 


iH 








fH 1 — 1 f — 1 


«H rH 


H rH 


rH 






rH 


rH 1 — 1 


1 

1 

1 


H H 








rH fH 


H 


> V. 














- rH^ H H 


rH 






H 


iH 


1 — I 


rH iH fH 


f — I 


1 — 1 


1 — ! 1 — 1 


rH 


( 
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VO ^ VJD VD UD VO 



(The positio'ns left empty contain, zeroes , not sh.ow.n.;) 



The analysis is, of- course, made in a manner similar to that for 
a single Youden. For the model without Car:ry-oTer , the varlahility residual 
on the orthogonal control factors , Rows and Columns can he gotten by the 
procedures of analysis of variance. Such results are shown in Tahle X3QCrb . 
When Treatment is Included the situation hecomes more Involved since it 
is necessarily confounded with Rows. It is necessary to solve simultaneous 
eq^uations which can he gotten from Equ. (l75) hy dropping the lines and 
colunms involving Change-over, l.e., the 30th through 38th of each. 

Working with these equations one gets the analysis of Tahle JODCTb, The 
appropriate design-data program for electronic computer may be used. In 
the actual equations helng used it is very important to remember that in 
getting residual squares one uses in connection with the estimate for 
\8 not the conditioning equation above but a suppressed equation formed 
just as for the other Rows with a right-hand constant of 10.2. Similarly^ 
in conjunction with the estimate for yg there is used the right-hand 
constant of 24.3 from a suppressed equation. Further, by dropping the 

A A A 

21st through the 29th line there may be found estimates of p , a . » 8 . 

A ^ j 

and 6^ together with the variability residual thereon, 1 . e . , the 6. 9100 
of Table XSCic. mien by solving the entire body of Equ. (175) the 

estimates are as in that table and the residual variability is 2.2830. There 
has been added the test of significance for Carries— over, per se. 
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Table XXXI - Satisfaction by Men, Periods and Treatments - The double 
ypuden 9x4x18 
a. Data 



Period 



Man 




1 








3 


4 


S\m 


I 


(1) 


2.5 


(2) 


3.5 


(4) 


3.4 


(8) 3.1 


12.5 


II 


(2) 


2.3, 


(3) 


2.3 


(5) 


2.5 


(9) 3.4 


10.7 


III 


(3) 


2.2 . 


(4) 


3,1 


(6) 


2.7 


(1) 2.1 


10.1 


IV 


(4) 


2.2 


(5) 


1.8 


(7) 


1.6 


(2) 2.5 


8.1 


V 


(5) 


2.3 


(6) 


2.6 


(8) 


2.5 


(3) 1.9 


9.3 


VI 


(6) 


3.2 


(7). 


2.0 


(9) 


3.3 


(4) 3.3 


11.8 


VII 


(7) 


2.5 


(8) 


2.7 


. (1) 


2.1 


0)2.2 


9.5 


VIII 


. (8) 


3.? 


(9) 


3.0 


(2) 


3.3 


(6) 3.8 


13.8 


IX 


(9) 


2.6 


‘ .. (1) 


1,6 


(3) 


1.9 


(7) 1.7 


7.8 


X 


(1) 


1.7 


(6) 


2.2 


0) 


1.3 


(2) 2.1 


7.3 


XI 


(2) 


2.3 


(7) 


1.6 


(4) 


1 . 8 


(3) 'l.3 


7.0 


XII 


(3) 


2.2 


(8) 


3,1 


( 5 ) 


2.6 


(4) 2.9 


10.8 


XIII 


(4) 


2.4 


(9) 


3 . 1 ' 


(6) 


3.4 


(5) 2.9 


11.8 


XIV 


(5) 


3.0 


(1) 


2.3 


(7) 


2.5 


(6) 3.1 


10.9 


XV 


(6) 


3.4 


(2) 


3.1 


( 8 ) 


3.4 


(7) 2.9 


12.8 


XVI 


(7) 


2.4 


(3) 


2,0 


(9) 


2.9 


(8)i2.5 


9.8 


XVII 


(8) 


2.8 . 


(4) 


2.7 


(1) 


2.1 


(9) 3.0 


10.6 


xyin 


m. 


3.0 


^ (5) 


2.4 


(2) 


2.7 


(1) 2.1 


10.2 


Sum 




46.7 




45.3 


46.0 


46.8 


184.8 


Mean 




2.59 




2.52 


2.56 


2.60 


2.57 


Sum Sq,. 


125.39 


119.53 


12^ 


i.BS 


129.10 


1958.88 



( 1 ) 



Contr , 
Ad J , Mn , 



b._ Ana, lysis for direct Treatment alone 
Jg) (3) (4) (i) ( 6 ) (7) (8) (9) 



-.kS +.i 8 -,U3 +,17 -.09 +.36 -.33 +.23 +.I0 

2.09 2.75 2.1k 2.1k 2.18 2.93 2.21 2.80 2.97 



Factors 


d.f. 


Residual Variability 
(Squares ) 


P , Rows & Columns (control) ' 


51 


9.0988 


Control factors plus Treatment 


k 3 ■ 
-! 


2.8211 



O 

ERIC 



F = ( 9.0988 ■- 2 . 82 ll )/8 
8,^3 2 . 8211/13 



11 . 






2^4 



c. Analysis for direct Treatment with allowance for Carry; 



(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) 


(8) 


J9l 


Contr . - • 47 


+ .20 


-.39 


+ .08 


-.05 


+ .31 


-.34 


+ .22 


+ .44 


AdJ. Mn. 2.10 


2.77 


2.18 


2.65 


2.52 


2.88 


2.23 


2.79 


3.01 


[i] 


[2] 


[3] 


[4] . 


[5] 


[ 6 ] 


[ 7 ] 


[8] 


A 

[ 9 ] 


Contr, --.01 


+ .22 


+ . o8 


-.19 


+ .06 


-,i6 


-.01 


-.09 


+ .09 



Factors 


d.f . 


Residual Variability 
(Squares) 


y , Rows, Columns S: Carries-over (control) 


43 


6.9100 


Control factors plus Treatment 


35 


2.2830 



_ (6.9100 - 2.2830)/6 ^ g 3 * 

^8,35 “ 2.2830/35 ^ ' 



j 

Factors d,f , | 


1 Residual Variability 
! (Squares) 


u 5 Rows 3 Columns & Treatments (control)’ 43 | 


2 . 8211 



Coiilrul facboi’s plus Carries— o'V'6r 35 ■ 2.2830 

I I 



^ 8,35 



(2.8211 - 2.2830)/8 _ t 07 w o 

^ ^ 2.2830/43 = 1-^r -^.b 
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d. Results by T^reatment and by previous Treatment — a crude analysis 



Treatment 





(1) 


(2) 


















Adj. 




After 


(3) 


(U) 


(5) 


(6) 


(7) 


(8) 


(9) 


' Sum 


Mean 


Contr . 


(1) 




3.5 


1.9 




2.2 


2.2 


2.5 




3.0 


15.3 


2.55 


-.01 


(2) 


2.1 




2.5 


3.U 




3.8 


1.6 


3.4 




16 . 8 


2.90 


+.34 


(3) 




2.1 




3.1 


2.5 




1.7 


3.1 


2.9 


15.4 


2.44 


-.12 


( h ) 


2.1 




1.3 




1.8 


2.7 




3.1 


3.1 


l4.i 


2.32 


-.24 


( 5 ) 


2.3 


2.T 




2.9 




2.6 


1 . 6 




3.4 


15.5 


2.53 


-.03 


(6) 


2.1 


3.1 


1.3 




2.9 




2.0 


2.5 




13.9 


2.50 


- . 06 


(?) 




2.5 


2.0 


1.8 




3.1 




2.7 


3.3 1 


i 15.4 


2.38 


-.18 


(8) 


2.1 




1.9 


2.7 


2.6 




2.9 




3.0 ! 


1 15.2 


2.72 


+ .16 


(9) 


1.6 


3.3 




3.3 


2.4 


3.4 




2.5 


! 

! 


16.5 


2.65 


+ .09 


Bk. 
























■ 


grd. 


2.5 


2.3 


2.2 


2.2 


2.3 


3.2 


2.5 


3.7 


2.6 ; 

i 








Mn. 


1.7 


2.3 


2.2 


2.4 


3.0 


3.4 


2.4 


2.8 


3.0 i 


46.7 






Suim l6 * 5 


21.8 


15.3 


21.8 


19.7 


24.4 


17.2 


23.6 


24.3 


184.8 






Adj. 

Mn. 


2.02 


2.76 


1.90 


2.69 


2.48 


3.05 


2.11 


2.99 


3.08j 








Contr 


55 


+ .19 


-.67 


+ .12 


-.09 


+ .48 


-.46 


+ .42 


+ .51^ 
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"attars, ^a contrlhntlons .are round h • ^ al.pOi«,,y„„ 

-- «• - d case llha the present , “ 1 „ 

are but li++.i - re Treatments and ro-- • 

little confounded, the «ter goes c. -r 
be observpfi +u -l S a quite rapldlv t+ 

--d that vith the tahla so nearly rin , ‘ 

the estimates of effect of Treat ^ 

ireatment are -pa4- t 

domparea With those of Table XXXIc. ‘ 





The correlaticn het-ween, estimates of Treatmerxt, proper, and Carry- 
over in Table XXXIc is —.08. This is so in spite of the considerable 
effect of Treatment. Indeed, the effect of Carries-over is very slight 
as shown by its specific test of significance that terminates XXXIc. 

As a result, the effect of Treatments is determined there with less reliabil- 
ity than without Carry-over in Table XXXIb j the strength of the experiment 
has been dissipated in the vain calculation of Carry-over. Presumably in 
such an experiment one should fall back on the more simple analysis without 
Carry-over . 

Faired Youdens 2(t x c x t) - Let us now turn to the analysis for paired 
Youdens, 2(t x c x t) , as discussed in Table XVII.', As an example, there 
are the results shown in Table JaDCII. This was a 2-week test on Treatments, 
(l)» ( 2 ), and ( 3 ). Six large groups of men received them with rcssults as 
shown In Table XlOCIIa. The analysis of the present data, as shown in Table 
XXXIIb and c, will be confined to the formation of treatment and carry-over 
estimates. Significance can hardly be calculated since the degrees of 
freedom (d.f, ) are so few for the residual sq^uares . This does not, however, 
inhibit the estimation of the effects. They are really the most Important 
thing in an experiment and the statistical analysis. There Is a tendency 
to stress significance too much— —probably because it is a good deal harder 
to find. For the estimation of treatment effects, without allowance for 
Carry-over, we may follow Equ. (lT2) to get results such as 

Y or(l) = g(yill + X32 1 + y4ll + ys?l) - (Ti + T:^ + Tr + T 4 ) 

1 6 

- [2{4l.O + 43. 3 + 51.0 + 48.0} - {92.3 + 90.0 + 96.3 + 94.T}]/6 

= - 1.12 . (176) 
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For the more extensive analysis ^ when Carry-over is involved, it is necessary 
to set up least squares equations, as in Equ. (ITT) or to use an electronic 
program, as shoTO in the Appendix, 

Since the present Design happens to be not only a paired Youden but a , 
paired comparison or single Change-over case, it belongs, In a sense, to 
Chap. VIII, devoted to such situations. There It will be pointed out that 
special techniques may be used in its analysis. Here, however, we shall 
proceed, using the general methods built up in the preceding dlsGussion and 
directed at cases with, generally, more than a single Change-over. 

In order to estimate the Treatment and Carry-over simultaneously it 
remains necessary to set up the Gomplete set of simultaneous equations 
as previously. Examining Table XXXiSi, it is at once apparent that the 
grand total contains all effects of Rows, Columns, Treatments and Carries— 
over equally, so that we may write the first line of the grand set of Equ. 
(ITT). 'When it comes to estimating the effect of Rows, it is necessary 
to recognize that their totals contain no effect of Colunm, in the sense 
that they contain them all equally and remembering Equ, ( 9 ) . On the other 
hand the total for Row contains much effect of Treatment and Carry-over. 
Following the lines used previously, for larger cases, there arise the 
equations , 
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12 

2 



ai Ct2 Ct3 a4 as ag 3l &2 Y2 Y3 ^1 °2 °3 



= Sum 



4 

4 



111 



-1 



-1 -1 
1 



-1 



-1 

-1 



-1 



1 



1 



4 

4 

1 1 
-1 

-1 



-1 



- 554.9 

= 92.3 

= 94.3 

1 = 90.0 

=. 96.3 

- 94.7 
= .0 
a 281.4 
= .0 
= 183.3 

- 191.3 

a . .0 

= 96 . 6 

- 91.3 
1 = .0 



(The positions left empty contain zeroes, not shown.) 



(ITT) 



The only analysis necessary on the ■basis of Eq.u. (iTT) is its 
solution to provide the estimates of Treatment and Carry-over, as shown 
In Table XJQCIlc. 
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Table XXXII - SatisfaGtlon under three kinds of Treatment In two Periods 
2 (3x2x3 ) 

a . Dat a 



Period 



GrouTD 


1 


2 


Sum 


I 


(l) Ul.O 


( 2 ) 51.3 


92.3 


II 


( 2 ) 51.0 


( 3 ) 43.3 


94.3 


III 


( 3 ) 46.7 


(1) 43.3 


90,0 


IV 


( 1 ) 51.0 


( 3 ) 45.3 


96.3 


V 


( 2 ) 46.7 


(1) 48.0 


94.7 


VI 


( 3 ) 45.0 


(2) 42.3 


87.3 


Sum 


281.4 


273.5 


. 554.9 



b. Anal:yals for direct Treatment alone 





(iL 


( 2 ) 


( 3 ) 


Contr . 


-1.12 


+ 2.33 


- 1,22 


Ad J . Mn * 


45.12 


48.57 


45.02 


Analysis for significance 


hardly possible with so few observations 


e ^ 


Analysis for direct Treatment with allowance for Carry-oyer 




(i) 


( 2 J_ 


A 

( 3 ) 


Contr. 


+2.77 


+5.57 


- 8.33 


AdJ . Mn . 


49.01 


51.81 


37.91 




[1] 


[ 2 ] 


A 

[3] 


. Contr , 


+ 7-77 


+ 6 . 4 t 


-i 4.23 



Analysis for significance hardly possible. 
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d. Results by Treatment and by -previous Treatment — -a crude analysis 



Treatment 



After 


(1) 


(2) 


(3) 


Siam 


Mean 


Contr , 


(1) 




51.3 


45.3 


96.6 


48.45 


+2.87 


(2) 


48.0 




43.3 


91.3 


46. 56 


+ .98 


(3) 


43.3 


42.3 




85.6 


41.74 


-3.84 


Bk.grd. 


4l.O 


51.0 


46.7 










51.0 


46.7 


45.0 


281.4 






Smo . 


183.3 


191.3 


180.3 


554.9 






AdJ . 
Mn. 


46,54 


48.07 


44.12 








Contr . 


+ .30 


+1.83 


-2.12 ; 


1 







In Table XXXI Id, there is shown the simple calculation, as on a desk 



calculator, for treatment and carry-over effects, when Rows are ignored, 

It goes fairly fast by iteration. The results agree badly with the 
more exact results of Table XXXIIc . 

The circumstance that it is hardly practical to make tests of signif- 
icance in Table XXXII is not basic but arises from the paucity of data. 

Such a Design could be fully analyzed if it were sufficiently repeated. 

Thus, If It were repeated once, l.e,, involved 12 Groups, there would be 
T degrees of freedom for the residual variability. With l8 Groups 
there would be 13 such degrees of freedom. 

Repeated Youdens - There must be some question as to how we should handle 

the very common experimental situation when some Youden rectangle, c < t , 
is laid down repeatedly. Thus we may consider the data, as in Table XXXlIIa, 
a 4x3xi+ (Yates rectangle) filled thrlce-over on 12 Groups of subJectB. 

Each Group was subject to 3 successive Treatments. Since the Design was 
repeated 3 times g = 3 . Then from Equ. (13^+), 

flTS) 

and the estimates for Treatments, with only them and not Carries-over , are: 



Treatment 




2T. 

1 


(k) 


( 1 ) 


1830 


1788 


+ 1.75 


(2) 


1752 


1730 


-1.17 


(3) 

(U) 


1719 

1800 


1709 

1824 


+ .42 
-1.00 



Sum 



I 7101 



7101 



,00 



(179) 
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As previously, in presenting such results, for practical consideration. 

It may V>e wise to produce not such estimates of treatment effects but 
them add.ed to the overall effect, y « 65.8 . Thus the "adjusted mean" 
for Treatment (l) is 65.6 + 1.8 = 67.6 in the sense that this is the 
mean anticipated if Treatment (l) had appeared in all Rows. Accordingly, 
the, say, adjusted averages for the Treatments are as shown in Table 
XXXIirb. 

As will transpire, the present problem is a peculiar one in that it 

would, not yield the analysis gotten from the other Designs in a general way. 

This was not discovered until the experiment was rim. The problem will be 

discussed in some detail below. For the moment it may be supposed, and 

in actual handling it was supposed, that the business of analysis again 

Involves setting up least spuares equations for the effects , y » , 

3. , Y and 6 appropriate for various levels of the models of Equ. 

J k Z 

(7) and Equ. (U3) and finding the variability variously residual. The 
handiest thing xt do seems to be to set up the full equations, as in 
(i^8), previously, and then, cut back to the lesser situations by Judid ^ ' v 
dropping rows and columns. ExMiinlng Table SDCIIIa, it is at once apparent 

that the grand total 2367 contains all effects of Rows , Columns , Treatments 
and Carries-over equally, so that we may write the first line of the grand 
set of Equ. (181), Hence 

y = 2367/36 ^ 65.75 . (180) 

When it comes to estimating the effect of Rows, it is necessary to recognize 
that their totals contain much effect of Treatment and Carry-over. Thus 





there may he writ ' an the second line of Equ. (l8i). Others may be written 



likewise, as shown in the following lines. The equations are much like 
those of the earlier, complete (no missing Rows) cases except that an 



account of the repetition of pattern the confounding in the first 12 lines 



is repeated. The total matrix is as follows: 































A 




A 








M 


“1 


«2 


ot3 








ay 


“8 


ag 


«10“1 1“123i 


Yl 


Y2 


T3 


Yi+ 6i 


62 


62 


64 


= Sum 


36 






































= 2367' 


3 


3 


























-1 


1 


1 






- 231 


3 




3 


























-1 


1 


1 




= 236 


3 






3 


















-1 










1 


1 


S 206 


O 

J 








3 


















-1 




j. 






1 


= 172 


3 










3 


















-1 


1 


1 






= 225 


3 












3 


















-1 


1 


1 




= li*2 


3 














3 










-1 










1 


1 


= 208 


3 
















3 










-1 




1 






1 


= 219 


3 


















3 












1 


1 






= 202 


3 




















3 










-1 


1 


1 




= 165 f 


3 






















3 


-1 










1 


1 


- 165 




1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 1 
















= 0 


12 






















12 
















^ 769 


9 






-1 








-1 








-1 


9 










3 


3 


= 610 


9 








-1 








-1 






'■ -1 




9 




3 






3 


- 58U 


9 


—1 








-1 








— i 










9 


3 


3 






^ 573 


























1 


1 


1 


1 








= 0 


6 


1 






1 


1 






1 


1 




1 -3 




3 


3 


6 








= 412 


6 


1 


1 






1 


1 






1 


1 


-3 






3 


3 


6 






^ 4 o 8 


6 




1 


1 






1 


1 






1 


1 -3 


3 






3 




6 




= 377 



1111 - 0 ^ 



• (The positions left empty contain zeroes, not sho»rn. ) 
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The entire set of relations may be put in matrix form, as in Equ. 

(181) and then various reduced situations may be extracted from it by 
the elimination of various lines, or equations, and the corresponding 
Columns. For computer calculation this may be done by simply changing the 

A 

appropriate lines to equations such as = 0 . 

For the more simple model of Treatments, ■without Carries-over , the 

variability residual on the control factors of Rows and Columns may be 

found most simply by the kind of calcalatlons used In analysis of variance. 

If one actually works a case such as this not on a desk calculator there 

are two types of short-cut to the numerical results,. For the situation 

without Treatments, l.e., the first line of the test of sigrtflcance in 

Table XXXIIIb, since Rows and Columns are completely orthogonal one may use 

facilitating algebra of the sort that was used in the analysis of 

variance. The result is shown in Table XXXIIIb. With the introduction of 
treatment effects it is necessary to go to Equ. (I8I), less the lines 

in%’Olvlng 6 ^ , because there is interaction bet'Wfien Rows and Treatments, 

These equations are very easily solved, even on a desk ealculator, to 

give treatment estimates as shown in Table XXXIIIb. For the Rows, the esti- 

mates now becomes 



ai 


«2 


«3 


«4 


as 


“6 


+11.39 


+12.58 


+3.50 


-8.81 


+9.39 


- 18.75 


A 


A 


A 










“8 


ag 


aio 


ail 


ai2 


+ 4 . 1 ? 


+6 , 86 


+1.T2 


-11.08 


-10.17 


-.81 
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When the Treatinents he come involved one may go^ so long as the Design is 
perfect and regular, to Eq^u- (1T8) and (179) for precise, explicit esti= 
mates vhich can then he employed rapidly to yield row estimates. The 
estimates for Colujnns are 5 of course, q^uite independent of anything but y 
They are : 

^ ( 33 : 

-1.67 +1.00 +. 6 t 

For this model, thi; reduction in squares, all taken from the total sum of 
squares is 



159p6l - y236T - {ai(23l) + 02(236) +. . .+ aigClpS)} 

- {61(769) + 62(801) + 03(T97)} 

- (n(6l0) + T2(58i+) + Y3(573) + 74(600)} 

= 945.2222 



when Lhe estimates are calculated with many decimal places. 

It might he supposed, and indeed was supposed when this experiment was 
done, that we might then proceed to consider the same data now with the 
posslhility of Carry-over, included, as usual. As things turned out Equ. 
(181)5 in full, are singular. Such will appear by using the program in 
the Appendix- Accordingly, the analysis with Carry-over is impoBBihle. 

The husiness of counting the nimiber of observations and constants to, 

be estimated in a repeated Design, such as the present, is a curious one. 




r. 
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To determine whether this is possible it is necessary to consider the basic 
Design — in the present case one of 4 Rows. Then one must count 

A 

y 1 3 

a. 3 6, 3 

for a total of 12 in 12 obeervations so that exact determination is possible 
If the number of observations had fallen short the situation would be 
singular. It will be noted that the present Design, 

Row I (1) (2) (4) 

A 12 

proved singular; the repetition nowise affected the issue. It is not a 
matter of under— determination but a peculiar featiire of the Design. This 
was unknown when the es^eriment was run. The Design 

Row I (1) (3) (4) 

A 2 1 

recommended in Table XII suffers from no such disability. The other 
Designs recommended in Chap, IV are all soluble, provided that they are 
not under — determl ne d . 





Ta~ble XXXIII - Satisfaction under four Treatments in three Periods, repeatgcl thrZ 
a. Desij.^n and Data 







(1) (2) (3) (_y _ 

Contr. +1.75 ” -1.17 +-^2 -1.00 

Adj, Mn. 67.50 64.58 66.17 64.75 



I actors 



d.f 



U 5 Rows & Columns (control) 22 
Control factors plus Treatment 19 



Residual Variability 
( Squares ) 



990.0000 

945.2222 



( 990 . 0000 945 » 22 22 ) /3 _ 30 N S 

-3,19 945.22'^2/19 

Analysis with both direct Treatment and Carry-over is Impossible. 
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It might reasonably be objected that the Design of Table XXXIII leaves 
something to be desired, since the total pattern seems over-repeated. It 
is, however, impossible to do much better. One cannot write in sets of U 
Rows with cyclic Columns and get, say. Treatment (l) followed equally by 
all three other Treatments. 

Misslnfi data aituatlons - As was previously observed in connection with 
la":in squares and single Youdens in many fields of actual practice one is 

bedevilled by incomplete Designs. Perhaps, as In the situation reported 
in Table XXXIV , one has T Treatments to try and it is practical to try 
4 on each of a number of men. Hence there is indicated a paired Youden, 
2(YxkxT)j as in Table XVII . In these,lt slould be I’emembered, the 
Ckrry— over Is balanced, each Treatment i-i. preceded by every other Treatment. 
There was, however, the practical difficulty that it was necessary to use 
20 existing Groups of participants for this Design that requires l^ Rows. 

As can be seen from the data, the Design was laid out for the first lU 

Rowo and then the first 6 lines of the Design were repeated. Since, however, 

each Row is associated with a Man, and men tend to disappoint us, we 

suffer then losses. As can be seen from the interruption of the cyclic 

arrangement of Treatments in Columns, the 3rd and 19th Men are missing 

(in the table they have been renumbered). As it happens the losses were 

such that all lines of the original Design are represented once although 

4 are still represented twice. It could easily have happened that some 

* 

were represented not at all. All this Is above the regular problem of the 
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literature ■which con jives a perfect and complete Design except that an 
observat : -n is mias'ing here or there. As has been previously remarked, 
the problems s or the consequences of Design incomplete by whole Rows are 
much more serious for '/ouden rectangles , when c < t , than for latin 
squares, when c = t . This is because in the rectangles Treatment ana 

Row are confounded. In the example of Table XXXIV, certain comparisons, 

within Rows 5 occur 6 times, certain 5 times and others but U times. 

Likewise, a given Treatment follows some Treatments twice but other 

Treatments only once. Finally, some Treatments occur thTice in a Column 
over others but twice. Such shortcomings, obviously, make any simple explicit 
solution of any kind quite impossible but do not at all seriously handicap 
the comparison of Treatments, These data are put quite simply into the 
program, as in Appendix for electronic computer with the results shown 
in Table XXXIVb or Table X]aiVc . 

It is possible to set up for Table XXXIV a full set of equations embrac- 
•ing Ms 06 • 5 Y-i, and 6 In matrix form. This would be somewhat 
tedious because of the size of the matrix. Among other things it is blown 
up by the m.unber of Rows. Granted that in principle, it could be set up 
then one would go to work solving for models of various degrees of 
complexity, as previously, and generate estimates of effects of Treatment 
and Carry-over, respectively, and eorresponding tests of significance. 





The first thing that may be noted in connection "with the least S’^nares 
equations is that since the Rows and (Jolumns remain orthogonal the variabil- 
ity residual on their estimates (at the lowest level) can still be gotten 
by the operations of the type associated with analysis of variance. The 
second thing is that since various Treatments and Carries-over occur 

various numbers of times s the estimate of m comes from 



^ ^ A ^ ^ ^ 

72fi - Y4 ^ Y6 Y7 ^2 "" ^6 ^ ^7 “ 3277 ^185) 

The Rov estimates are confounded to just the extent they would be if the 



Design were perfect ^ i.e.^ we have 



4 a 1 


- Y 3 - 


Y 5 


^ Y6 


+ 


5 l 


+ 02 


+ 


64 


+ 


III 

< 


18U 


ha 2 


- Y 4 “ 


Y6 


- Y 7 


+ 


62 


+ 63 


+ 




+ 


iy = 


125 4 


• - 


. . . 


■ • 




• • 


* 


. * . 




• 


* 


• * 


• . * 


4 a 2 o 


- Yl - 


Y 3 


- Y 4 


+ 


5 b 




+ 


62 


+ 


ku - 


205 j 



(l86) 



The column estimates are no longer orthogonal to everything but are: 

l8gi - Y3 - Y5 + 18 m - 789 

1802 - Y4 - Ye - 53 - ^5 + l8y - 821 

T f- 

1803 - Y6 - Yl - ^4 - 5 b + 18m = 19k j 

A A ^ 

1804 “ Y2 “ Y 4 - 5 e " + l8y = 8 T 3 J 

The treatment estimates are confounded because c < t and further by the 
irregularity of Rows to become hideous as , • 



IOyi — CX 3 “ O5 — Ot0 — ag — a 



etc. 



otig - aij - a^S + 61 + @4 •* 1 + 5 lOy — 

(188) 



The least squares equations for Carrles-over are likewise confounded. 



In spite of the complexity of the confounding, which much influences 



the business of estimating effects, the 
then remains as simple as ever. For y 
unconfounded » appeal may be made eithi 
variance or to orthogonal least sq^uares 
Carry-over, the estimates of treatment > 
other estimates are : 

M ^ U5.5O 

“1 02 aie 

+1.25 -14.52 + 6.13 

@1 @2 03 04 

-1.39 -.10 -1.34 + 2.83 

SO that the estimate of* residual square; 

155,985 - 45.50(3277) 

- {+ 1 . 25 ( 184 ) - 14.52(125) + .... 

- {- 1.39(789) - .10(821) - 1 . 34 ( 7 ! 

- C- 1 . 99 ( 421 ) - l.l 8 ( 48 o) +...... 

= 1973.2000 



calculation of reduced variability 
. Rows and Columns, which are still 
iT to the technique of analysis of 
equations. For the model, without 
effects are as in Table XXXIVb and 



> (189 ) 

is simply 

. . + 6.13(205 )} 

4 ) + 2.83(873)} 

. . .+ .76^535)} 

( 190 ) 



if the estimates, with many decimal places, are in fact employed. This 
result is shown in Table XXXIVb. 
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For the model without Treatments 

y = h5.ij-6 





OC2 • 


• * • > c « ^IS 


- - 61 


-14.24 


+5-28 


Si 


02 


03 04 


-1.63 


-.0? 


-1.32 +3.02 


61 


62 . 




+1.07 


+3,35 


-.66 



the estimates are: 



(:i9l) 



The resultant residual variability is gotten on the lines of Equ. (190 ) 
In a similar way for the full model the estimates of treatment effects and 
Carries-over are as shown in Table XXXIVc and other estimates are: 



y = 45.45 

Ot ^ Qi ^ ^ m m m % m m Q ^ 0 

+ .12 -14.90 +5.9T 

01 02 S3 S4 

-1.37 -.17 -1.34 +2.88 j 



^ 192 ') 



so that the estimate of residual squares is 



155,985 - 45.45(3277) 

- {+ .12(184) -14.90(125) + ... + 5.97(205)} 

- {- 1.37(789) - .17(821) - 1.34(794) + 2.88(873)} 

- {- 1.41(421) - .53(480) + ... + 1.19(535)} 

- {+ .74(321) + .84(453) + ... - .64(391)} 

= 1874.1917 (i 93 ) 



if the estimates are employed, in fact, with many decimal places. 




is shown in Table XXXIVc . 



.. if 




This 
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Table XXXIV - An example of the highly incomplete kind of* Design that occurs 



in praotioe . A partially repeated paired Youden, 2 ( Jxhx7 ) • 
a. Design and data 



Week 



Man 




1 




2 




3 




4 


Sum 


I 


(1) 


55 


(2) 


37 


(4) 


47 


(7) 


45 


184 


II 


(2) 


37 


(3) 


25 


(5) 


25 


(1) 


38 


125 


III 


(i^) 


24 


(5) 


24 


(7) 


29 


(3) 


46 


123 


IV 


(5) 


36 


( 6 ) 


44 


( 1 ) 


39 


(4) 


52 


171 


V 


( 6 ) 


42 


(T) 


54 


( 2 ) 


50 


(5) 


55 


201 


VI 


(7) 


49 


( 1 ) 


37 


(3) 


56 


( 6 ) 


62 


204 


VII 


( ) 


42 


(5) 


45 


(3) 


. 35 


( 2 ) 


32 


154 


VIII 


( 2 ) 


55 


( 6 ) 


60 


(4)' 


' 52 


(3) 


60 


227 


IX 


(3) 


54 


( 7 ) 


60 


(5) 


57 


(4) 


54 


225 


X 


(k) 


42 


(1) 


44 


(6) 


46 


(5) 


44 


176 


XI 


(5) 


46 


(2) 


48 


(7) 


54 


(6) 


47 


195 


XII 


(6) 


42 


(3) 


54 


(1) 


42 


(7) 


42 


180 


XIII 1 


(7) 


49 


(4) 


42 


(2) 


47 


( 1 ) 


48 


lo6 


XIV 


(1) 


34 


(2) 


43 


(4) 


46 


(7) 


54 


177 


XV 


(2) 


52 


(3) 


55 


(5) 


42 


(1) 


42 


:9i 


X 'I 


(3) 


38 


(4) 


38 


(6) 


26 


(2) 


28 


130 


XVII 


ih) 


50 


(5) 


62 


(7) 


50 


(3) 


61 


223 


XVIII 


(6) 


42 


(7) 


49 


(2) 


51 


(5) 


63 


205 


Sum 


789 


821 




794 


873 


3277 


Sum sq. . 1 


, 35 1 ' 


T49 


39, 


499 


36,1 


672 


44,1 


065 i 





b. Analysis for direct Treatment, •without allowance for 



Carry-over 





(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) 


Conbr . 


- 1.99 


- 1.18 


+ 4.13 


-.60 


+ .14 


- 1.28 


+ .78 


Ad J . Mn . 


43.51 


44.32 


49.63 


44.90 


45.64 


44.22 


46.28 
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Factors 


d.f . 


.Residual Variability 
( Squares ) 


/S 

u , Rows 


& Columns (control) 


51 


2188.3194 




Control 


factors 


plus Treatment 


45 


1973.2000 




TP 


(2188,3194 - 1973 


.2000)/6 .. ,, 




^6, 


45 


1973 . 2000/45 


- 0 ^ n - 0 s 




c - 


Analysi 


Ls for direct Treatment and Carry-over 




(1) 


( 2 ) ( 3 ) 


(4) 


(5) (6) 


(7) 


Contr . 


-1. 4l 


-.53 + 3.83 


-.98 


-.60 - 1.49 


+ 1.19 


Ad J . Mn . 


44.04 


44.92 49.25 


44.4? 


44.85 43.96 


46.64 




iij__ _ 


[b [ 3 ] 


[h] 


rs] [6] 


_L7j 


Contr . 


+ .74 


+2.84 +.71 


-.14 


-2.04 -1.46 


-.64 



Factors 

p 5 Rows 5 Columns & Carries=over (control) 
Control factors plus Treatments 






U5 



Residual Variability 
(Squares ) 

20U5.6i+89 

187^.191? 



■m _ (S045-6409 ~ iS7^»1917)/6 
6,39“ ^ i8t4. 1917/39 



.59 N.S. 
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In Table XXXIVc, not only are the effects of direct Treatment (k) , 
and Carry-over [£] , of low significance but their correspondence, i.e., 
their correlation is only +.lfn. 

To conclude the discussion on situations such as that in Table XXXIV, 
where essentially Rows are missing, two things may be observed. First, it 
becomes essential to analyze by use of least squares equations, for even 
p and Columns are, of Gourse, no longer orthogonal to other effects and 
must be embraced in the general system of simultaneous equations. The 
degrees of freedom are a little reduced for Rows and for residual 
variability. 



Designs more or less Youden - From the general preceding discussion 
and from the oase of Table XXXIV, in particular, it should have become 
fairly plain that with the best of intentions. In a practical way all we 
get is a Design that is more or less Youden and its shortcomings make 
little practical difference. This must lead us to wonder whether we 
might not be a lot more casual about designing and indeed we may. If we 
use, as we generally must, either the method of writing out least squares 
equations or a program that does thesemo thing directly from Design and data, 
the balanced and nice features of the Youden are no longer vital. For 
cases with c < t , i.e,, the rectangles, we are essentially in a situation 
where all cells of the combination of Rows and Treatment are not filled— 



we are in a mlBSing plot situation. We carefiilly arrange this incomplete 
fill so that solutions for treatment effects in teimis of sums of observations 
are fairly simple. Thus arise all owe niceties. Freed from the limitations 
of the desk calculator we should rewrite our statistical method — ^as has 
been observed by a number of people in recent years . The present situation 



ERIC 



9^. an illustration of the general principle 



There remain some limitations to the writing of Designs that have 
Varying strictness. It is assimed that the Designs that might he written 
would he in Rows and Columns as at present, that we should he fimdamentally 
Interested in comparisons within Rows, i.e., that Rows would tend to 
have leas variahllity within than among, and that Carry-over would remain 
a possihlllty. Some of the limitations would then he ^ 

a, Prohahly there should he as many trials projected for one subject 
or individual as another, i.e., the Rows should he of equal length. 

Then we might continue to write in terms of t Treatments in c Columns 
for r Rows . 

h. The niamher cr of ohservations would have to he great enough to 
permit explicit solution for all the effects. Row, Colimin, Treatment and 
Carry-over that would he required, 

c. There would prohahly he little point to a Design where the fill, 
f = c(c - l)/(t - l) 5 were less than unlt.y, i.e,, it were not posslhle to 
contrast each Treatment with each other Treatment at least once. 

d. While we may he ahandoning the concept that f need he an 
Integer, i.e,, that all comparisons can he made the same number of times, 
it prohahly remains desirahle that all comparisons he made more or less 
the same number of times. Otherwise the tests of slgnlflcenice may become 
badly out. 

e. It remains imperative that all Treatments are Interknit, Thus It 
would not do for Treatm.ents (l) through (6) to he written exclusively in 
certain Rows and ( 7 ) throi^h (15) to he written exclusively in other Rows 





with no Rows containing some of "both sets of Treatments. Nor may one even 
approach such a condition. 

f. So nearly as possible, all Treatments should occur equally in all 



Such Designs belong, of course, to the class of partially balanced, as 
in the literature. 

As an illustration of a Design not Youden, but falling well within 
the limitations first set outgone might write half a double Youden 
(9x4x18) as in Table XXXV t taken from Table XXXI. In Table XXXV half 
the comparisons occur once and half twice. Perhaps in a more general way, 

we could conceive a Design where all comparisons occur at least once 
but some once more than others. The results from such a Design can be 
put through the analysis by least squares equations, such as we have used 
for strict Youden Designs, quite easily with the results shown in Table 
XXXV. (It must be allowed that this particular experiment is rather 



The complete system of relations obtaining from the reBults of Table 
XX^ may be written out by noting that 



Columns . 



meager . ) 



36y « 93.6 



9@1 + 9y = 23.6 




( 195 ) 



and the matrix, regular like that for the full, perfect, simple Youden 
rectangles, previously shown, as follows; 
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{The pO'Sitions , left empty, contain zeroes not shO'Wn) 
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Proceeding with the model at various levels from Egu. 
practice use the program in the Appendix, there are gotten 
Table XXXV, 





(196), or in 
the results of 



Table 



O 
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XXXV - An. example of neax-Youden Design 
a. Design and Data 



Period 



Man 




1 




2 




3 




4 


Smi 


I 


(1) 


2.5 


(2) 


3.5 


(^) 


3.4 


(8) 


3.1 


12.5 


II 


(2) 


2.3 


(3) 


2.5 


(5) 


2.5 


(9) 


3.4 


10.7 


III 


(3) 


2.2 


(i+) 


3.1 


(6) 


2.7 


(1) 


2.1 


10.1 


IV 


ih) 


2.2 


(5) 


1.8 


(7) 


1.6 


(2) 


2.5 


8.1 


V 


(5) 


2,3 


(6) 


2.6 


(8) 


2.5 


(3) 


1.9 


9.3 


VI 


(6) 


3.2 


(?) 


2.0 


(9) 


3.3 


(4) 


3.3 


11.8 


VII 


(?) 


2.5 


(8) 


2.7 


(1) 


2.1 


(5) 


2.2 i 


9.5 


VIII 


(8) 


3.7 


(9) 


3.0 


(2) 


3.3 


(6) 


3.8 


13.8 


IX 


(9) 


2.6 


(1) 


1 , 6 


(3) 


1.9 


(7) 


1.7 


7.8 


Sum 


23.5 


22.8 


23.3 


24.0 


93.6 



b. Comparisons 



VS, 


(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) 


(8) 


(9) 


(1) 




o 


oo 


oo 


o 


o 


oo 


oo 


o 


(2) 


K 




o 


oo 


oo 


o 


o 


oo 


oo 


(3) 


XX 


X 




Q 


oo 


oo 


o 


o 


oo 


(4) 1 


XX 


XX 


X 




o 


oo 


oo 


o 


o 


(5) 


X 


:jcx 


XX 


X 




o 


oo 


oo 


o 


(6) 


X 


X 


XX 


XX 


X 




o 


oo 


oo 


(7) 


XX 


X 


X 


XX 


XX 


X 




o 


oo 


(8) 


XX 


XX 


X 


X 


3QC 


XX 


X 




o 


(9) 


X 


XX 


XX 


X 


X 


XX 


XX 


X 






2?2 



G. Analysis for direct Treatment alone 





( 1 ) 


iSS 

(2) 


(3) 


(k) 


A 

(5) 


(6) 


( 7 


A 

(8) 


A 

(9) 


Contr . 


-.53 


+ .16 


-.30 


+ .39 


-.22 


+ .37 


-.h6 


+ .21 


+ .37 


Ad j . Mn . 


2.07 


2.76 


2.30 


2.99 


2.38 


2.97 


2.Xk 


2.81 


2.97 



Factors 


d.f . 


Residual VarlalDility 
( Squares ) 


y , Rows & Colujiins (control) 


2k 


5.13 


Control factors plus Treatments 


16 


1.53 



8,16 



1. 53)/8 



1.53/16 , 



k . 71** 



d . Direct •breatment and carry-oTer estlinates from simultaneous 



equations 





(1) 


A 

(2) 


(3) 


ik) 


(5) 


(6) 


(T) 


(81^ 


19) 


Contr . 




+ .29 


-.27 


+ .07 


-.51 


+ .07 


-.56 


+ .35 


+ .70 


Ad J . Mn . 


2.U6 


2.89 


2.33 


2.67 


2.09 


2.67 


2,0it 


2.95 


3-30 




A 

[1] 


[2] 


A 

f3] 


A 

[W 




[6] 


[ 7 ] _ 


[8] , 


[j] 


Contr . 


+ .25 


+ .53 


+ .52 


+ .03 


+ .ok 


-.k5 


-.31 


-.61 


-.00 



Factors 


d.f. 


Residual Variability 
( Sauares ) 


y , Rows, ColuBms & CeLrrles-over 


(control) 


16 


3.23 


Control factors plus Treatments 




8 


.82 



0,8 



(3.23 - .Q2)/8 

. 82/8 



= 2.95 N. 




27 <i 



Factors 


d.f . 


Residual Variability 
( Squares ) 


U , Rows, Columns & Treatments (control) 


:6 


1.53 


Control factors plus Carrles-over 


8 


.82 



^ ( 1.53 - . 8 g )/6 

8,8 .8278 



.87 N.S. 
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The results of Table XxxV are a little difficult to Interpret in a 
pre-ctical way. Briefly, the effect of Treatments is significant when 
Carry-over is not Involved hut fails significance when it is. Carry-over, 
per se , is far from significant. Finally,, the correlation between Treat- 
ment and Carry-over Ip the trivial -.08. In such a practical situation, 
an experimeritallst would probably be inclined to take his decision on the 
more simple model. There remain, of course, problems of a fine theoretical 
kind; If one alwayp chooses as It were the better or best result, then 
all he need do is try enough models and something will be trivially 
significant. In the present case, it happens that the results may be 
compared with those from the fuller Table XXXI. Then it will be noted 

that, again, the inclusion of Carry-over reduced the value. of F for 
Treatments , F'urther reflection gives the further impression that the 
estimates for Treatments are much the more stable, from the one table to 
the other, in the situation "^rhere Carry-over is not Involved, 
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Breaklnig Treaxment varla'bllity up - Very often, as was discussed previously 
in connection with the latin square and the single Youden, after data 
have been subject to analysis for the general significance of Treatments 
the variability among Treatments must be further broken up. The Treatments 
are not simply so many alternate varieties, in themselves. Procedure of 
this t? pe Is further illustrated on a (double) Youden rectangle, where 
c < t . An exainple of an ejperlment , where it is necessary to separate 

out component factors among the Treatments is provided there by the data 
of Table XXXI, on a 9xUxl8. The results will be discussed now from the 
point of view of breaking down the variability of Treatments into, compon- 
ent factors . There they were regarded simply as 9 Treatments , The Treat- 
ments consist of 3 chemical or physical variables each at 2 levels (a high 
value and a low value), in all combinations to yield, in the symbolism 
usual in this field: 

High A, high B, high C = abc 
High A, high B, low C — ab 
High A, low B, high C — ac 
High A, low B, low C * a 
Low A, high B, high C — be 
Low A, high B, low C — b 
Low A, low B, high C - c 
Low' A, low B, low C = (8) 

Standard sample. 

In such a problem it is necessary to sort out the orthogonal effects of 
A, B and C and their interactions. The neophyte may wonder. Indeed, 
the inclusion of Treatment (9) but will find that his "practical" 
colleague Insists on including a "bench-mark." 





at 



276 



In partitioning the sioms of squares in a Youden setups the hast 
procedure seems to he to work with the treatment estimates very much as in the 
more simple prohlems one works with totals and then finally to adjust sum 
of residual squares in allowaiice for scale* This is the general procedure , 
recoDiin.ended and followed for the earlier illustrations. If our huainess is 



to partition the effect of Treatments without allowance for Carry-over , we 
may start with the estimates In Table XlSlh. Our first husiness is to 

separate out the odd comparison of ( 9)3 the "bench-mark" from the experi- 
mental comparisons. Following Equ. (36) 



K 



Q.Q988 - 2.8211 



<'-,48)2+( + .l8)2+(-.l+3)2+(+.lT)^+(-.09)2+(+.36)2+(-.33)2+( + .23)2+( + .i+0)2 

6.7552 ( 197 ) 



(when actually estimates with 4 decimal places are used In the denominator). 
On the model of Equ. (35)j the variability among the 9 Treatments that is 
due to the single comparison of this standard with experimental material Is 

6.7552 {( + .40)2 + („.i ^8 +.18 -.43 +, 17 -‘09 +.36 -.33 +.23)2/8} 

^ 6.7552 {(+.40)- + (-.39)^/8} 

- 1.1935 . (198) 



The variability between the two levels of A required as usual, the total 
for all results under the high level A or, as it is commonly put 3 the 
comparison 

( abc + ab +ac +a) - ( be +b+c+( 8 )). 

This in the terms of the Design o. Table XXXI Involves the comparison 
of the total for (l), ( 2 ), (3) and (4) with the total for all result b under 
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the low level, i.e., (5)s ( 6 )j ( 7 ) and ( 8 ) and also the total under all 8 
of these Treatments. The result from the general Eq^u. (35) is 

- . ^495 (199 ) 

Similarly the variability between the 2 levels of B is 5 as it is coimaonly 
put 5 due to the comparison 

(abc + ab + be + b) -- (as + a + c + ( 8 )) 

or in the terms of Tahle XXXl of (l), (2), ( 5 ) and (6) with (3), (4), (7) 
and (8). The result is 



6.7552 { 



(-.03)^ . (-. 36 )^ 

k k 



( . 39 )^ 

8 



^ .0959 



( 200 ) 



Hmllarly the varlahillty 'between the 2 levels of C Is 



< Tcqp / (- 1 . 33 )^ . (+.94)2 (.39)- 

to. 7552 i 8 



4.3242 



( 201 ) 



There remains some variability among Treatments ascribable to Interaetlons 
of the factors B and C* It is easily enough gotten out 3 if of inter- st 5 

but it is somewhat teyond our present buslnejs to go too fully into the 
analysis of variance in this sense* To those familiar with the general 
procedures there will be no problem. The remainder mean square Is gotten by 



( 9.0988 - 2.8211 - 1.1935 ■ .4ii95 - .0959 - 4.3242)/4 ^ .0536 . 




( 202 ) 
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Finally, all •these mean squares must "be compared with residual mean square 
of 

2.8II43/U3 ^ .0654 . ( 203 ) 

The ■whole ■business may be conveniently packaged or presented in the form 
of the analysis of sums of squares as shown in Table . XXXVIa. 

One can, alternatively, partition the treatment effects after allow- 
ance had been made for Carry— over, Tliese Galculations would be based upon 
Table XXXIc instead of JODClb. The main difference would be in the reduced 
number of degrees of freedom for residual factors . The results are 
summarized in Table XXXVIb . One might even partition Carry-over, although 
in this table it Is so slight as hardly to merit such delleacy. 

It may be noted that the present breakdown Is completely correct 
because all the Treatments are represented equally in this Design. We 
are not in the position, as with incomplete Designs, of making some kind 
of apology for the discussion being a little approximate. It may he 
noted that where such balance does not exist , the partitioning of variability 
among Treatments may lead to some highly an,omalous res'ults. 
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Tabae X X XVI .- Analv.sis. of sums of . scLuares ...ajid-Qf mean sauargs in breaking 

up treatment effects 

a. Separa-bion of treatment effects without allowance for 
Carry "-over 



Souz^ce 


d.f . 


Mean Squares 


F 


Fac'tor A 


1 


.4495 


6.87 * 


Factor B 


1 


.0959 


1.47 N.S. 


Factor C 


1 


4.3242 


66.12 *** 


Exp. Remainder 


4 


.0536 


.82 N.S. 


Stan. vs. Exp. 


1 


1.1935 


18.25 


Res 5 , dual 


37 


.0654 





b. Separation of Treatmeirb effects with allowance for Carry-over 



Source 


d.f. 


Mean Squares 


F 


Factor A 


1 


.3475 


5.33 




Factor B 


1 


.1195 


1.83 


N.S. 


Factor C 


1 


2.7760 


42.58 




Exp. Remainder 


4 


.0558 


.86 


IT,S. 


Stan. vs. Exp, 


1 


1,1606 


17.80 




Residual 


29 


.0652 
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Prom the analysis as of Table XXXVIa, factor A has a significant 
( 5 % level) effect. Also factor C has a significant (.1^ level) effect. 

It is important not to rest at this point, perhaps from the exhaustion 
of getting out the significances but to remember that the ■world wants 
to know at what level of A and C it should operate. This can, of course, 
be found by referring to the estimates of Table XJCXIb. Such reference 
to the estimates of Treatment effects shows that the higher value of A ' 
is dlsfavored™by an amount of, say, (— ,56 + •17)/^ = -,l8. On the other 
hand, the higher value of C is favored — ^by an amount of, say, (-1.33 + 

• 9^)/^ = +. 57 * The Interactions of A, B and C, i.e,, the remainder teritij 
were not significant. The importance of this operation Is that we may 
thus discover the highly significant elements among the Treatments as 
a whole . 

The way one handles results from an experiment depends, of course, on 
the fimdamental nature of 'the practical problem Involved. Estimates, 

such as those discussed, of treatment effects, are In many es^eriments, all 
that one needs from the Youden analysis. More commonly one goes on to 
some test of the significance of the variation among the estlniates. Veiy 
often one stops here, saying they are just t things, they do vaiy 

significantly and such and such are best. It may, at times, be of practical 
Interest to go on and regress estimates of result against some measurable 
character of the Treatments . In other studies the treatment estimates may 
be displayed against the background of factors at various levels and in 
combination, as has Just been done in Table XXXVI. The variety of problems 

and of procedure is endless. To discuss them all fully would take a much 

greater book than the present; it would take indeed a very general text- 

O 

of statistics. 





Design vrlth several sections ~ In actual experimentation one may always 
encounter problems where an es^eriment is done in several sections. This 
is true of change-over experiments among others. Thus one may have, for 
a very simple case, a 7x4xli| experiment carried out in 2 hospitals, for 
instance, essentially the first Design of Table XVII except that the first 
7 Rows are done in the one and the last 7 in the other. Necessarily, 
there are 2 physicians and one may work in the spring and the other In the 
autumn. Now there obviously arise a numL ir of serious questions such as 
whether the effects of Colu mn s are the same in the 2 sections. It may he 
that the estimates for Colijmns tend to rise with the passage of time, i.e., 
progress through the table of data in the first hospital but fall in the 
second. Such effects often occur with season. Then plainly, one cannot 
necessarily take out a column effect common to the two hospitals . One 
will have to do something like analyze them separately, each for its own 
kind of column effect and then make some kind of combination of treatment 
effects. The possibilities of difficulty are endless. One may have to 
anticipate that there is actually a difference In treatment effects between 
hospitals . One may even have to anticipate that the magnitude of extraneous 
variability is very different from one hospital to the other, as is all too 
often the case and as becomes very seirious when the two sections are of 
different size; one is a 7x4xl4 and the other a 7x4x7- The problems 
multiply when there are more than 2 hospitals . 
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The "type of diff'icul’by envisaged is common in Agnicultiire where sections 

of the Design are run in several successive years. Then the effect of time, 

the very effect of experimental Treatment and the nature of extraneous 

variability may be anticipated to vary. 

The difficulties of an experiment, in several sections, are nowise 

peculiar to change-over experiments. An adeq.uate discussion of them would 

require a work much beyond the scope of the present book. Here it is 

impossible to equip people to deal adequately with such a diversity of 

problems* they would have to acquaint themselveB with the much larger and 

more general problems. Here it can only be said that such problems are quite 

natural and real and the analysis of such Designs should be approached with 

the greatest cautlcn. 
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VIII. Designs Involving pairs or a single Chanffe-oye^ 

The peculieLT na-bure of studies with single Change-over 

Design with single Change-over 

Analysis when there Is no conditioning Period In the Design . . . 
Analysle when there is a eondltloning Period in the Design . . . 
Procedure when there are 2 Treatments ... 

Analysis when there are 3 Treatments 

Breaking up treatincnt variahillty ... 

Missing data situations on paired Designs .... 

Douhle reversal trials ...... 



Page 

284 

206 

291 

301 

507 

327 

328 

329 
333 




285 



The laj nature of studies with single Chajige-over - Designs involving 



a single Change-over, i.e., the study of only 2 Treatments or Materials 
on one experimental imit , where quantity is involved are, as said at the 
very ■beginning of the present hook, prohahly the most fundamental form of 
experimentation. They are the form of design naturally set up "by men, 
naive about such things. The instincts of these men. are very sound. 

They often unfortunately suppose, however ,■ that since things can only 
he compared in pairs , then it is only possihle to study two things . In 
fact, by the com'bination of many comparisons in is possihle and often very 
profitahle to study a numher of Materials or Treatments with paired 
comparisons. We might, for instsLnce, study h Treatments, (l) , (2) , (3) 
and (4) hy issuing the pair (l) and (2) to one man, (l) an.d (3) to another 
man and so on for (l) and (4) , (2) and (3) , (2) and (4) , (3) and (4) 
in all to 6 men. As was discussed in Chap. I, various rearrange- 
ments and extensions might he made to balance firstness and secondness etc. 

Each man would yield some sort of rating to each membtr of the pair. It 
should be reiterated that the present discussion is concerned with quantity. 
Note that there is another class of paired comparisons where it is , so-to- 
speak, the games won rather than the number of goals that tell. Such data 
would arise if it were a matter of deciding which were the better Treatment 
for a patient. This is, of course, a most interesting subject on which 
much has and could be written but not here. The question of preferences is 
outside the realm of the present discussion. ^Nor, for that matter, are we 
concerned with intimate "simultaneous" quantitative estimations such as the 
famous technique in Animal Husbandry, .of trying two diets on twin calves. 
With such data we are not here concerned but rather with quantitative 



results such as number of hours slept or at least quantitative ratings. 



O 

ERJC 






285 



Biometrieians involved in paired comparison considerations seem to 
worry a lot about circularities or eddies of preference. Thus possibly 
(l) beats (2), (2) beats ( 3)5 (3) beats (l). Thus a man can win against 
his wife at chess, she cdn win over her mother but the latter can win 
over the son-in-law. The moral superiorities are In three different 
dimensions. No doubt similar complexities could occur if several things 
were tried by one participant as' when he might try 3 or 4 things in succession. 
The possibility of such complexity does not seem to bother people. It would 
be so complex that it would be hard to see and therefore not the occasion of 
concern, "What the eye does not see the heairt does not grieve." 

Just as in Youdens in general or for latin squares , as a special ease , 
so in paired studies Carry-over of treatment effects may often be considerable 
and should be allowed for if possible. It may, however, be necessary to 
free the estimates of treatment effects from Carry-over. It may further be 
required to get Carry-over out of the residual mean square — Carry-over blows 
it up. There are even times when it is of great practical Importajice to 
estimate the effect of Change-over. Thus lire are often under the necessity of 
analyzing for Change-over. Indeed, dn paired comparisons, the problem of Carry- 
over may be more a.cute than in any other class of design. This Is so because 
the confounding of Carry-over with direct treatment effect may be extreme. 

Single Changes-over or paired studies have one simplifying peculiarity 
over the more ambitious Designs previously discussed in such detail and 
that is that it is commonly possible to complete them. Thus if one pro- 
poses 24 pairs of comparisons one can generally get them. This is because 
the requirements are so simple that even if some subject disappoints the 

O 

ERIC 



287 



286 



experimenter "by not completing his comparison It is very often possible 
to get a replacement even if a little later. Accordingly, this is one 
field where we shall have little to concern ourselves with incomplete design. 

The paired test may he regarded as the extreme of Youdenish designs. 
This paired comparison will. In general, of course, require more than t 
lines to compare t Treatments, It is often, however, such a convenient 
Design that it is the only situation where one should not he unduly 
concerned about the number of pairs that may be necessary. It does seem 
desirable to make all comparisons as nearly as possible the same niimher 
of times. For this it is necessary to have c| pairs, as previously 
observed. There is a conBlderable literature on paired compariBons when 
more than 2 Treatments are Involved. It is usually referred to as Designs 
with 2 units per block. Thus Cox (1958) gives an elaborate table of such 
Designs. His discussion is not restricted to the balanced cases which 
seem here preferable. Nor is h e concerned with Change-over, His material 
and methods are discussed to some extent in the concluding section of this 
Chapter, under the heading of jalsslng data situations. 

Design with single Change-over - Paired studies or those with single ChanGe- 
over, l.e., each subject may try 2 Treatments, are the only situation where 
it seems desirable to go into multiple designs, l.e,, as in Equ. (ITI), 
where r = gt , g > 2 , beyond a double Youden. The number of Rows is 
g times the nimher of Treatments, There are a few paired studies indicated 
in Table IV hut since the value of g , there, is arbitrarily restricted to 
3, there are very few cases. Here we are concerned with any arrangement 
necessary to test properly t Treatments and g will have to he as big 
as is nec .sary. On the other hand it is unnecessary to search diligently, 
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as in the cases of t > 2 foi! solutions ^ we can always write out a Design 
on general principles and need only consider such Designs. 

The number of Rows for such cases of t evens as occur in Table IV, 
and quite generally , is 

r = 20* = t(t - l) (ZOk) 

whence 

g - (.t-l) ■ (20 5) 

with fill of f = 2 . Appropriate design may be illustrated most briefly 



by the 


exaiapleB ^ 








4x2x12 




g=3 


6x2x30- 




S=5 


Row I 


(1) 


(2) 


Row I 


(1) 


(2) 


A 






A 




1 


V 


(1) 


(3) 


VII 1 
A i 


' (1) 


(3) 

2 


A 




2 


■= i 

XIII ! 


(1) 


(4) 


IX 


1 (1) 


(4) 


M 




3 


A 1 




3 


XIX ; 


(1) 


(5) 


i 






A 




4 








3DCV 


(1) 


(6) 








A 




5 



In more detail, together with data, we have for the former case 



Period Period 



Row 




1 


i 


2 


Row 




L 


2 


I 


(1) 


yiii 


( 2 ) 


7122 


VII 


(3) 


7713 


(1) 


7721 


II 


(2) 


yzi2 


(3) 


7223 


VIII 


(4) 


7814 


( 2 ) 


7822 


III i 
1 


1 (3) 


^313 


(4) 


7324 


IX 


(1) 


7911 


(4) 


7924 


IV ; 

j 


(4) 


7414 


(1) 


7421 


X 

I 


( 2 ) 


710,12 


(1) 


710,21 


V I 


(1) 


7511 


(3) 


7523 


XI 1 
1 


(3) 


711,13 


( 2 )- 


711,22 


VI ; 


( 2 ) 


7612 


(4) 


7624 


XII 1 


(4) 


712,14 


(3) 


712,23 




It may be noted again that this Design caji be rearranged into the form, 
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Period Period 



Row 


1 


2 


Row 


1 


2 


I 


(1) 


(2) 


X 


(2) 


(1) 


VII 


(3) 


(1) 


V 


(1) 


(3) 


IX 


(1) 


(4) 


IV 


(4) 


(1) 


II 


(2) 


(3) 


XI 


(3) 


(2) 


VIII 


(4) 


(2) 


VI 


(2) 


(4) 


III 


(3) 


(4) 


XII 


(4) 


(3) 



when plainly all comparisons occur twice and twice only (f - 2) and 
that each Treatment occurs an equal numher of times in each Period. It 
will he further noted that in this Design the Change-over is balanced, with 
every Treatment following (or preceded hy) every other Treatment. For 
serious experimentation, however, it is hest to use the form of writing 
in cyclic Columns and probably with the abridgement previously indicated. 
Such Designs will, generally, be of the character: 



Row 


I 

A 


(1) 


CVI HI 

I 


Row 


t+1 

A 


(1) 


(3) 

2 


Row 


2t+l 

A 


(1) 


(4) 

3 










Row 


(t-l)2 

A 


(1) 


(t ) 
t-1 



The cases of 4x2x12 and 6x2x30, previously shown, are examples of this. In 
practice some multiple of 20^ Biay, of course, be employed. 
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The number of Rows for such cases of t odd, as occur in Table IV ,1 , 
and quite generally, is 

(206) 

(207) 

with fill of f = 1 . Appropriate design may be Illustrated by the 

example of t = 5 , 

l.e,, 5x2x10, briefly es follawe; 



Row I 


(1) 


(2) 






1 


VI 


<1) 


(4) 


4 




3 



la natm Retell, together with iete^we have 



whence 

g ■ (t-l)/2 



Row 


I 


Period 

2 


Row 


Period 

1 2 


I 


(1) 


yiii 


(2) 7122 


VI 


<1> nei 


^624 


II 


(2) 


^1222 


^223 


VII 


<2) 7^j2 


(5) 7725 


III 


(3) 


^133 


(4) 7324 


VIII 


^183 


y 821 


IV 


(4) 


3^144 


(3) 7425 


IX 


^194 


(2) 7^22 


V 


(5) 


^155 


(1) y52i 


X ' 




3 5^10.2.3 



This Design may again be rearranged into the form 



Period Period 



RO'W' 


1 


2 


Row 


1 


2 


I 


(1) 


(2) 


IX 


w 


(2) 


VIII 


(3) 


(1) 


VII 


(2) 


(5) 


VI 


(1) 


(4) 


III 


(3) 


ih) 


V 


(5) 


(1) 


X 


(5) 


is) 


II i 


; (2) 


(3) 


IV 


(h) 


(5) 



where plainly all comparisons occur once and once only (f = l) and that 
a given Treatment occurs equally in each Column. Such must obviously 
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be the case for all t even in a Design of this kind. Further, it will 



be noted that Change-over is unrepeated but not balanced. This is to say 
that no Treatment ever follows any other Treatraent twice but it does not 
follow all other Treatments. For balance of Change-over one would write 
a more extensive Design, to wit. 



Row I 
A 


( 1 ) ; 

1 


IV 


( 1 ) (3) 


A ! 


2 


XI j 


( 1 ) ik) 


A ; 


3 


XVI i 


(1) (5) 


A ! 


k 



This la, of course, a Design with 2 C 2 Rows Just as for the case of 
t even. Designs of type with c| Rows will generally be of the character 



Row 



I 

A 



Row 



t+1 

A 



( 1 ) ( 2 ) 

1 



(1) ih) 



Row : (1) (t_l) 



t-1 



The case of 5x2x10, previously shown, is an example of this. Designs of 
typo with 2 C 2 Rows will have the same character as those for t , even, 
previously discussed. Either type may in practice appear as some multiple 
of cf or 2 C 2 , respectively. 
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All ’these Designs have ■unrepeated Change-over, i.e., no Treatment, is 
preceded by any other Treatment more than once and they all have Treatments 
in cyclic order in the Columns . 

Note that a 2 (3x2x3) was illustrated and analyzed in Table XXXII. 

The very special case of t - 2 in a paired or single change-over 
Design is reserved to a later special section. 

Analysis when there is no conditioning Period in the Design - Consider the 
most typical and basic kind of paired study, when there is no conditioning 
Period and there is no repetition of the comparisons. An example is 
provided in Table XXXVII, of 6x2x30. The number of Rows, r , Is as in Equ. 
(20h ) , In terms of the more general discussion earlier, g = 5 , 
i.e., there are 5 times as many Rows as there are Treatments. 

We conceive that for the paired comparison there exists the model 

first introduced in connection with the latin square. For Column 2 ( Columns 

after the 1 ) there may he a models as in Eg^u* (US)^ involving hoth direct 

st 

treatment effects and Carrles-over . On the other hand in the 1 Column 
there is only allowed, as in Equ. ( 7 ) the direct effect. It is a matter, 
again, of suppoBing that aJiy effect of background Carry-over is common to 
all Column 1 and hence completely confounded with it. 

The data of the present experiment may be handled the same as those 
of any other Youdenish Design. There may he set up a .mtrix of equations 
as previously or the program of the Appendix may he used. Setting up least 
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squares equations for the effect of Rows (pairs one gets 



2a 1 + Yl + Y2 =yil + yi2 -5.7 

^ A ^ 

2u 2 + Y2 Y3 ~ y21 + y22 ® ^*3 



(2CS ) 



20£^0 + Y 5 Y6 ~ yia,! + yi 8,2 - 6.2 

when the subscripts on the observations y are understood to indicate the 
Row and Coluim of their occurrence. Also setting up the least squares 
equation for Treatment (l), one gets 

A ^ A A A 

IOyi + ai + ag + U7 + an + ai3 + ajg + ajg + Q21 “25 + “26 

= yii + ys2 + y?i + yii,2 + yis,! + yi6,2 + yi 9 ,i + y2i,2 + y2s,i + y26,2 

(209) 

and similarly for each othsr Treatment. The overall effect y is simply 
the corner average 3.212. The effect of Period i easily found. Thus that 
for Period 2 is 

' r ^^±2kH - *' 

= 3.18T - 3.212 

= - .125 (210) 

because Coluiiins are precisely balanced or orthogonal to all other effects. 

Such a matrix woulds however, be obviously insupportable. One must rely 
on the results from the computer program in the Appendix or use explicit 
methods of solution, as discussed below. 
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In the ease of paired comparisons, when only 2 Treatments occur in a 
Row, it is possible, however, to take steps that are more difficult in the 



larger Designs. One might use the special process if one were doing the 
analysis on a desk calculator. Thus consider the observation yj_2k 



the l^^(i ^ I... 2 C 2 ) Row, the Column, 

and even) Treatment and also the observation 
(1 = l...t) Carry-over, from an experiment. 



under the k"^^ ( k = 1 . 
The husiness may he 



* . 1 5^ ^ U 

th 



handled by considering the differenoes 



d. 

1 



^ifk£ 



^ilk> 



(k’ # k 
£ ^ k' ) 



^i ^i2k*£ ^ilk 
(£ = k) 

J 



( 211 ) 



of result for a given Treatment (k), in Period 2 less that in Period 1. 

Thus for Treatment (l) in Table XXXVIla, the successive values of , whe 



( 1 ) is in the second Period, ar*e —.1, *0, -.2 etc. and of d^ are — .3-, —.3 
-.3, -.1 etc. The primes indicate that Treatment (l) occurred in the first 
Period. It may be assured that these differences, such as 



- yi 221 - yill - Y 2 “ Yl + + 262 + El 

d 2 = y2213 “ y213 = Yl “ Y3 + ^3 + 202 + ^2 



( 212 ) 



with respect to Treatnient (l), can be made readily enough to yield least 
sg.uares estimates of the parameters ■yj and Sj • In general 



( 213 ) 



^ {(t - l)Ed^ + Sdi - 2t(t - l) 62 }/t(t - 2) 1 

5, = {Id. + Id! - U(t - l) 62 }/(t - 2) J 

K. 11 



Uov we may get Yj^ and '^£(^ ~ 1^) ^ noting the differences 

for the Rows in which it occurs and whether or not it oeeurs in the first 
Column. In the case where the coinplete Design of 2 C 2 is repeated g 
times these results generalize to 



^ {(t - l)2d^ + Ed^ - 2gt(t - l)g2>/2st(t - 2) 

A 

«£ = {Id^ ~ Ed^ - hg(t - l)02)}/g(t - 2) 

(t - k) 



(21k) 



For the model of Eq_u. (f), without consideration of possible Carry- 
over, the least squares estimate for Treatment may he illustrated hy 

A A 

y^ or (k) ^ (Ed - Ed' )/2t . ( 215 ) 

In the case when the complete Design of gcf repeated g times 



Y, ^ (Ed - Ed' )/2gt 



( 216 ) 



In illustration consider the estimates from the data of Table XXXVII for 



Treatment alone. From Eq^u. (215 ) ‘ 

A A 

(1) or Yi = {- .1 + .0 - .2 - .1 + .1 - 
^ + .050 . 



.3 - .3 - .1 + .1)}/12 

( 217 ) 
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For all k 5 the results are as shown in Table XXXVIIb. The resixLt is an 
application, essentially, of ltu.(il2), that was used for Youden rectangles, 
irom that, 

(1) or n - (22yyi - T.)/12 

a {2(32.?) - 64.8}/12 

= .050 . (218) 
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Further, from Eq.u, (210 ) , 

01 = 9?. 1/30 - 192.7/60 - + .025 . (219) 

Again calculating from Equ. (213) for direct treatment effects, when allowance 
is made for possible Carry-over, 

( 1 ) or Yi ” {“ "3“ *3~ .3“ .1+ .1+ 5(“ .1+ .0— .2— .1+ .1) 



- 2(6)(5)(- .025)}/6(t) 
.038 



feao ) 



as shown in Table 3Q[XVIIlc together with the corresponding results for other 
Treatments and with the adjusted mean, as previously. For this model, the 
estimate of Carry-over of Treatment (l) is from Equ. (213), 

[1] or 5i - {- .3 - .3 - .3 - .1 + .1 - .1 + -0 - .2 - .1 + .1 
- 4(5)(- . 025)}/4 

» - .175 ^ 221 ) 

as shown in Table XXXVIIIc together with the corresponding results for other 
Ca^r ies-over • 

In paired studies, it is often very easy to set up the paired units 
so that the Design is generally complete and repeated. In fact, we 
often do. In general, we may have g repetitions to give us say 
gt (t-l) Rows for t even, ^us. In a study of 6 Treatments we 
might have 5 ( 6 x 2 x 30 ), or 5 replicates* Such procedure should greatly 
improve the quality of Treatment es-^iittates . 297 
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Conceiving Table XXXVII as essentially one of 30 differences » each 
written in terms of @2 » * (perhaps 6 ^ ) and » there may be 

written out a test of significance for effects in terms of pair differ- 
ences ^ but let us Content ourselves with the business of estimating Treat— 
ment and carry-over effects. Such elaboration along lines differing 
from the general situation for Youden rectangles might conruse our general 
reader and thus do more harm than good. 

The handling of paired or single change— over experiments by the 
consideration of the difference within the pairs, as above, does make It 
possible and Indeed fairly easy to analyze for direct Treatment and 
carry-over effects at least in situations such as the above. It must 
be noted that the perfect execution of the Design is important, otherwise, 
the solution of the equations becomes intolerable. Such advantage is 
actually trivial because mainly anyone interested in such a problem 
would use* on an electronic computer* the program in the Appendix, 

For the paired Design, i.e., with single Change-over per ej^erimental 
unit, when t is odd but there is a total of 2C2 Rows with each Treatment 
followed (or preceded) by all other Treatments , everything is much as just 
discussed for the case of t even. The differences may be conventionalized 
as in Equ, ( 22 l); the estimates of effect of Treatment alone are as in 
Equ, (215 )j the estimates for the more elaborate model are as in Equ. ( 213 ). 

For the paired Design, I.e., with single Change-over per experimental 
unit* when t is odd but there is a total of only C2 Rows, as discussed 
in the immediately preceding section explicit solution is much more Involved 
than for the well-regulated case of 2C2 Rows, A given Treatment can only 
be followed (or preceded) by half the other Treatments. Carry-over Is 
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unrepeated but not balanced. Of course, for the model, without concern for 
Car 7-over, the estimates of effect of Treatment are simple, being 

^ A 

Yj^ or (k) = (Ed - Ed')/t (222) 

like Equ* ( 215 )^ For the more elahorate model. Including Carry-over, the 
explicit statement for any giver alue of t is very heavy and for t in 
general onerous, 

S\ oh a paired study may "be analyzed as a Youden, As previously, there 

could he set up a matrix for the equations relating p § a,ll ^ ^ 

and all would be very extensive and tedious, Ihe really 

important relations are shown in Table XXXVIId where it is plain that direct 
treatment and carry-over effects are in large measure independent. Of 
course, half the observations, from the first Column of the Design, 
have no carry-over effect. Such a matrix would a.lso teach us that a very 
large part of the experimental evidence was going to the estimation of 
Row effects, a control factor, and without e^erimental value. In 
practice, one would, probably, use the general Youden analysis, as in 
the Appendix, for an electronic computer. This program is organized so 
that the miiltipllcity of Rows does not essentially affect the size of the 
operation. The results of such operation are shown in Tables XXXVIIb and c. 
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Table XXXVII - Satisfaction vlth 6 Treatments over 2 Periods on 30 Groups 
a. Data 

Period. Period 



( 



Group 


1 2 


Svm 


Diff . 


Group 1 


1 


I 




2 1 Sinn 


DifT 


I 


(1) 


3.0 


(2) 


2.7 


5.7 


-.3 


XIX 


(1) 


3.3 


(5) 


3.2 


6.5 


-.1 


II 


(2) 


3.0 


<3) 


3.3 


j6 . 3 


+ .3 


XX 


(2) 


3.3 


(6) 


3.4 


6.7 


+ .1 


III 


(3) 


2.6 


(4) 


3.0 


5.6 


+ .4 


XXI 


(3) 


3.5 


(1) 


3.4 


6.9 


-.1 


IV 


(4) 


3.3 


(5) 


3.0 


6.3 


-.3 


XXII 


(4) 


3.1 


(2) 


3.6 


6.7 


+ .5 


V 


(5) 


3.1 


(6) 


2.7 


5.8 


-.4 


XXIII 


(5) 


3.3 


(3) 


3.2 


6 . 5 


-.1 


VI 


(6) 


3.0 


(1) 


2.9 


5.9 


-.1 


XXIV 


(6) 


3.3 


(4) 


3.5 


6.8 


+ .2 


VII 


(1) 


3.1 


(3) 


2.8 


5.9 


-.3 


XXV 


(1) 


3.8 


(6) 


3.9 


: 7.7 


+ .1 


VIII 


(2) 


3.2 


(4) 


2.7 


5.9 


-.5 


XXVI 


(2) 


3.2 


(1) 


3.3 


6.5 


+ .1 


IX 


( 3 ) 


2.1 


(5) 


2.8 


4.9 


+ .7 


XXVII I 


1 (3) 


2.9 


(2) 


3.1 


6.0 


+ .2 


X 


(4) 


2.9 


(6) 


3.4 


6.3 


+ .5 


XXVIII: 


(4) 


3.7 


(3) 


3.1 


6.8 


-.6 


XI 


(5) 


3.5 


(1) 


3.5 


7.0 


.0 


XXIX i 


(5) 


3.2 


(4) 


3.1 


6.3 


-.1 


XII 


(6) 


3.7 


(2) 


3.8 


'7.5 

I 


+ .1 


KQC i 


(6) 


3.4 


(5) 


2.8 


6.2 


-.6 


XIII 


(1) 


3.5 


(4) 


3.2 


! 6.7 


-.3 


Sum 


97 


. 1 


95 


.6 


192.7 


- 1.5 


XIV 


(2) 


3.5 


(5) 


3.5 


! 7.0 


.0 


Mn. ; 


3 


.237 


3 


.187 


3.212 


XV 


(3) 


3.8 


(6) 


3.0 


. 6.8 


-.8 


- 














XVI 


(4) 


3.1 


(1) 


2.9 


; 6.0 


-.2 
















XVII 


(5) 


3.3 


(2) 


3.2 


6.5 


-.1 
















XVIII 


(6) 


3.4 


(3) 


3.6 


, 7-0 


+ .2 

















b. Analysis for Treatmen'fcs •wl-bhou-fc allowance for Carry-over 



(1) (2) (3) ik) jj) (6) 

Conbr.' +.050 +.033 —.075 —.017 +.033 —.025 

Adj. Mn. 3^^62_ 3-2^5 3- 13 7 3.195 3-2^5 3.187 



Factors 

y , Rows Ss ColunuiS (control) 
Control factors plus Treatments 



_ Residual Variability 
' (Squares ) 

29 ! 1.78 

2k , 1.71 



^ ( 1.78 - 1.7l)/5 _ 
5,24 1 . 71/24 “ ' 





20 N.S. 
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c. Analysis for Treatment vlth allQ-wance for Carry-over 





A 

(1) 


(2) 


A 

(3) 


(4) 


A 

(5) 





Contr . 


-.038 


+ .146 


-.025 


-.004 


-.029 


-.050 


AdJ . Mn. 


3.1Ti^ 


3.358 


3.187 


3.208 


3.183 


3.162 




[ij 


[2] 


[3] 


L4] 


[5J 


I6J_ 


Conir , 


-.175 


+ .225 


+ .100 


+ .025 


-.125 


-.050 






Factors 






d.f. 


Residual Variability 
(Squares ) 


y 5 Rows 


5 Columns Se Carrles-over 


( control ) 


24 


1 . 66 


Cori'brol 


factors 


plus Treatment s 




19 


1.60 



p _ (1 .d6 - 1.60)/5 

5.19 1.60/19 



.15 N.S. 



d. Sa-tlsfactlon by Treatment and by previous Treatment—A crudi 



Tr'eatmant 



After 


(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


Siaa 


AdJ. 

Mn. 


Contr . 


(1) 




2.7 


2.8 


3.2 


3.2 


3.9 


15.8 


3.17 


-.02 


(2) 


3.3 




3.3 


2.7 


3.5 


3.4 


16.2 


3.25 


+ . 06 


(3) 


3.4 


3.1 




3.0 


2.8 


3.0 


15.3 


3.03 


-.16 


(4) 


2.9 


3.6 


3.1 




3.0 


3.4 


16.0 


3.19 


.00 


(5) 


3.5 


3.2 


3.2 


3.1 




2.7 


15.7 


3.13 


-.06 


(6) 


2.9 


3.8 


3.6 


3.5 


2.8 




16.6 


3.35 


+ .16 


Bk . gr . 


3.0 


3.0 


2.6 


3.3 


3.1 


3.0 










3.1 


3.2 


2.1 


2.9 


3.5 


3.7 










3.5 


3.5 


3.8 


3.1 


3.3 


3.4 










3.3 


3.3 


3.5 


3.1 


3.3 


3.3 










3.8 


3.2 


2.9 


3-T 


3.2 


3.4 


97.1 






Sum 


32.7 


32.6 


30.9 


31.6 


31.7 


33.2 


192.7 






AdJ ,Mn. 


3.27 


3.27 


3.07 


3.16 


3.16 


3.34 








Contr . 1 


1 +.06 


+ . 06 


-.l4 


-.05 


-.05 


+ .13 











The F test for Treatments and Carries-over in Table XXXVII are rather 



s\irprlsingly small. It is therefore, the more curious that they seem to 
show correspondence I the correlation coefficient is +.79* 

With regard to the intermingling of carry-over effects and direct 
treatment effects in a 2-parlod experiment involving more than 2 Treatments 
it may be observed that they can be separated, as is discussed elsewhere. 

As was pointed out in earlier chapters on latin squares and Youden 
rectangles. It seems impractical to mahe estimates of treatment and carry- 
over effects explicitly in terms of observations . It is best to set up 
the laast squares equations. The explicit possibilities are, however. 
Interesting in that they warn us of what Desigas are Impossible. For 
instance, one cannot astlmate both carry-over and direct treatment 
effects In 2x2x2 or 3x2x3 as has already appeared. Even, however, for 
the t X 2 X t (t great), the explicit solution in tezms of observations 
y , a solution involving the full model is very heavy. 

Consider next and last the situation for t even when there are 
2 C 2 Rows. After 2x2x2, the next case is l;x2x^. The standard design for 
Treatinents , l.e.: 



Period 



Row 


1 


2 


I 


(1) 


(2) 


II 


(3) 


(1) 


III 


(1) 


(U) 


IV 


(2) 


(3) 


V 


(h) 


(2) 


VI 


(3) 


(4) 


VII 


(2) 


(1) 


VIII 


(1) 


(3) 


IX 


(4) 


(1) 


X 


(3) 


(2) 


XI 


(2) 


(4) 


XII 




(3) 
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would work since there are but 19 parameters to be estimated from 2k 
observations. Plainly » treatment and carry-over effects can be estimated 
for all such paired comparison designs with t 4 3 t even. 

Consider first the situation for t odd where there are cf Rows. 
After 3x2x3, the next case is 5x2x10. The standB.rd design for 5 Treat- 
ments , i , e . : 



Period 



Row 


1 


2 


I 


( 1 ) 


( 2 ) 


II 


(3) 


( 1 ) 


n I 


( 1 ) 


(4) 


IV 


(5) 


( 1 ) 


V ^ 


‘ ( 2 ) 


(3) 


VI 


(4) 


( 2 ) 


VII 


( 2 ) 


(5) 


VIII 


(3) 


(4) 


IX 


(5) 


(3) 


X 


(4) 


(5) 



would Just work hecause there are 19 parameters to be estimated from 20 
observations. Plainly, all effects. Including Carry-over, could be 
estimated for all paired comparison designs with t ^ 5 , t odd. 

Analysis when there is a conditioning Period In the Design - A 2-Period 
or paired experiment may he prefaced by a conditioning Period , although 
as was earlier discussed in connection with Youden rectangles the difficulties 
of design are considerable. The difficulty is that it will not do to put 
the conditioning Period i.inder the same Treatment as the first Period of 
the experiment proper. If one had done so in the case reported in Table XXXVII 



O 
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each Treahnieii'b ■would he pi'eceded hy itself 5 tinies hut hy each other 
Treatment hut once. No doubt Ingenuity could get around such problems in 

particular cases but would probably be better employed in making work 

some of the more simple procedures recommended in this book. Nonetheless 

cases may occasionally be produced and must be analyzed. Such a case, 

which appeared of itself, is raported in Table XXXVIII. 

In Table XXXVIII , 5 Treatments were tried, with a conditioning Period. 
Treatments occur equally in each of the condition Period 0, and the proper 
experimental Periods 1 and 2. The Design shows, howe'ver , small departures 
from balance, characteristic of many experiments, as they are actually 
executed. For instance, the comparisons (Columns 1 and 2) are: 



1 

vs . 


(1) (2) (3) (U) (5) 


(1) 


3 5 5 3 


(2) 


'3 3 5 5 


(3) 


5 3 3 5 


(h) 


5 5 3 3 


(5) 


3 5 5 3 



The Carries-over are as balanced as is possible. They are: 



Treatment 



After 


(1) 


(2) 


(3) 




(1) 


(1) 


k 


3 


3 


3 


3 


(2) 


3 


k 


3 


3 


3 


(3) 


3 


3 


k 


3 


3 


(h) 


3 


3 


3 


k 


3 


(5) 


3 


3 


3 


3 


h 
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Let us consider first the model with only direct treatment effects 
For this it is perhaps necessary to form the estimates 



y = 5^21/80 

= 6?. 76 



( 223 ) 



and 

01 ^ 2733/^0 - y 
== + .56 



(22U) 



The estimate of the effect of Treatment (l) is gotten from the considera- 
tion of all differences involving (l) with a correct sign. The result is: 

20yi + Y2 “ Y3 - Y4 + Y5 - “IT (225) 

and similar least sq^uares equations can he set up for ( 2 ), (3)» (^) and (5) 
It would he logically possihle to write out for the situation of 
Table )QCXVIII a matrix of all the least sq_uares equations hut it would 
be very massive, because there are 40 Rows which are very empty because 
there are so few data in those. Rows. The program for electronic 
computer, shown in the Appendix may, however, be used because it has 
been particularly designed to be free of the question of the niamber of 
Rovs . 

Using the program of the Appendix, based upon the usual least squares 
equations 5 the estimates and the test of signifioaiice are shown in Table 
X3QCVIIIb. The addition of Carry-over to the model much Increases the 
value of F assignable to Treatments although it still Just misses 
significance . 
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Table XXXVIII - A 2-Ferlod experiment 



a. Design and data 



Period 



Group 






1 ^ 




2 1 


1 Smn 


I 


((!)) 


(1) 


68 


(2) 


63 


131 


II 


((2)) 


(2) 


66 


(3) 


6h 


130 


III 


((3)) 


(3) 


70 


(h) 


TO 


ll+O 


IV 


iih)) 




6U 


(5) 


56 


120 


V 


((5)) 


(5) 


75 


(1) 


70 


ii ^5 


VI 


((2)) 


(1) 


6o 


(3) 


65 


125 


VII 


((3)) 


(2) 




(h) 


71 


ih? 


VIII 


.((M) 


(3) 


78 


(5) 


81 


159 


IX 


((5)) 


(M 


80 


(1) 


76 


156 


X 


((!)) 


(5) 


69 


(2) 


76 




XI 


((2)) 


(1) 


62 




70 


132 


XII 




(2) 


66 


(5) 


65 


131 


XIII 


Uh)) 


(3) 


65 


(1) 


62 


127 


XIV 


((5)) 


(M 


53 


(2) 


56 ■ 


109 


XV 


((1)). 


(5) 


6h 


(3) 


67 


131 


XVI 


((3)) 


(1) 


73 


(h) 


65 


138 


XVII 


((3)) 


(3) 


73 


(5) 


73 


llt6 


XVIII 


((3)) 


(2) 


66 


(5) 


58 


12 U 


XIX 


((5)) 


(3) 


63 


(1) 


63 


126 


XX 


((D) 


(1) 


71 


(2) 


69 


lUO 



Period 



Group 


0 


1 




? ! 


Sum 


XXI 


((2)) 


(2) 


63 


(3) 


64 


127 


XXII 


((3)) 


(3) 


6k 


(D 


70 ! 


: 134 


XXIII 


((h)) 


(h) 


66 


( 1 ) 


53 : 


: 119 


XX] V 


((D) 


(h) 


56 


( 2 ) 


61 : 


117 


XXV 


((2)) 


( 1 ) 


73 


(3) 


68 


i4i 


iocvi 


((2)) 


(a) 


68 


(3) 


69 ; 


; 137 


XXVII 


((5)) 


(5) 


76 


( 2 ) 


71 j 


1 147 


XXVIII 


((2)) 


(5) 


63 


(3) 


65 ' 


128 


XXIX . 


((3)) 


(a) 


67 


(h) 


68 ' 


' 135 


XXX 


((it)) 


(3) 


73 


(5) 


58 ; 


; 131 


XXXI 


((D) 


(5) 76 


(2) 


67 i 


; 143 


XKCII 


((D) 


(1) 


65 


(2) 


66 ' 


1 131 


XXXIII 


((2)) 


(2) 


66 


(h) 


68 


134 


XXXIV 


((h)) 


(h) 


69 


(5) 


69 


138 


XXXV 


((5)) 


(5) 


83 


(1) 


81 


i 64 


XXXVI 


((D) 


(1) 


68 


(3) 


70 i 


1 138 


X]OVII 


((3)) 


(3) 


68 


(h) 


68 : 


j 136 


XBCVIIl 


((D) 


(D 69 


i5) 


66 


1 135 


XffiCIX 


((5)) 


(5) 


61 


(1) 


68 


j 129 


XL 


((5)) 


(D 


79 


(D 


78 


I 157 


Sum 




2733 


2688 


.'5421 



b. Analysis for Treatments vithout allowance , for Carry-over 



( 1 ) 



M 



(3) 






(5) 



o 

ERIC 



Contr . 


-.69 +.20 +.61 


+1 


.37 


-1.49 


AdJ. Mn. 


67.07 67.96 68.37 


69.13 


66.27 




Factors 


d.f . 


Residual Variability 
(Squares ) 


y 5 Rows & 


Columns (control) 


39 




532.13 


Control factors plus Treatments 


35 




480.15 


^4,35 


= -(532.13 - i.80.15)/4 ^ 55 

480.15/35 
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c. Analysis for Treatments with allowance for Carry-over 



A A A 

( 1 ) ( 2 ) ( 3 ) 


A 

( 4 ) 


A 

( 5 ) 




Contr. - 1.92 = 1.96 +.58 


+3.60 


-.31 




Adj. Mn. 65. 8U 65.80 68 . 3 i+ 


71.36 67.45 




[ 1 ] [ 2 ] [il 


A 

[ 4 ] 






Contr. ~k. 2 k -2.82 +3.55 


+4.79 


- 1.20 




Factors 




d.f . 


Residual Variability 
( Squares ) 


U 5 Rows 3 Columns & Carries-over 


( control ) 


35 


477.78 


Control factors plus Treatments 




31 1 


371.81 


p. _ iMr. 78 - 371 . 81)74 

4,31 371 . 81/31 


- 2.21 N.E 


3 . 




Factors 




d.f. \ 


Residual Variability 
(Squares ) 


jj , Rows, Columns & Treatments (control) 


35 i 


480.15 


Control factors plus Carrles-over 


1 


31 i 

_ _ . i 


371 . 81 


„ _ ( 480.15 - 371. 81 ) /4 


- 2.26 W.£ 






4,31 371.81/31 


1 ■ 
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d. Results by Treatment and by previous Treatment — A crude 



Treatment 



After 


(1) 


(2) 


( 3 ) 


( 4 ) 


( 5 ) 


; Sum 


AdJ. 

Mn. 


Contr 


(1) 


68 71 

65 68 

=272 


63 69 

66 

-198 


65 68 

70 

=203 


56 70 

65 

=191 


69 64 

76 

=209 


I 

1073 


67.03 


-.73 


( 2 ) 


60 62 

73 

^195 


66 63 

68 66 
^263 


64 64 

69 

^197 


71 68 

68 

=207 


63 65 

58 

=186 


1 

i 

io 48 


65.57 


-2.19 


( 3 ) 


73 62 

63 

=198 


Ih 66 

67 

=207 


70 73 

64 68 

^275 


70 70 

68 

=208 


81 73 

58 

=212 


1100 


60.75 


+ .99 


(it) 1 


76 53 

78 

=207 


66 56 

61 

=183 


78 65 

73 

=216 


' 64 66 

69 69 

=268 


56 69 

66 

=191 


1065 


66.55 


- 1.21 


( 5 ) ^ 

{ 


70 81 

68 

=219 


76 71 

67 

= 211 + 


63 67 

65 

=195 


80 53 

79 

=212 


75 76 

83 61 

^295 


1135 


70.92 


+3.16 


1 

Sum i 

f 


1091 


1065 


1086 


1086 


1093 


5421 






AdJ . Mn. j 


68.23 


66.70 


67.81 


67.95 


68.12 

1 




67.76 




Contr. i' 


+ .U7 


-1.06 


+ .05 


+ .19 


+ * 36 ^ 
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It may be noted that the correspondence between Carries-over and 
Treatments was again high in Table XXXVIII. The correlation between the 
two kinds of estimate waf^. +. 92 . 

Procedure when there .are 2 Treatments - One of the commonest problems in 
experimentation, that of deciding between 2 Treatments, is, unfo->"tunately , 
particularly Intractable. It is practically impossible to test them in 2 
Periods. The design most coimnonly Rttempted is discussed immediately below. 
It is employed, to great mischief, for it tends to give erroneous results. 
This special case has such peculiar difficulties and yet is of such great 
practical importance that it is discussed below in a particularly thorough 
way. It becomes necessary to get away from Designs in 2 Columns but the 
matter is best cleared up here. It is possible and often both practical and 
convenient to write special 2—treatio.ent DHsigns that make it possible to 
estimate direct treatment effect free of Cariy-over. Two such are shown 
immediately below. They illustrate, incidentally, the importance of Cari^- 
over , 

Tiie situation for the smallest of latin squares ^2x2x2 ^is of partic- 
ular Interest because it Is Impossible of analysis, is much beloved by 
.’'practical” experimenters and must lead to many false decisions. For 

this 2-treatment Design, it Is impossible to estimate Carry-over, if It 
occurs to free the estimate of direct treatment effect of it. The point may 
be seen algebraically. The typical, "straightforward” Design, commonly 
used for 2 Treatments, is 



O 
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Period 



Sub.iect 


1 


2 


I 


(1) 


yiii 


(2) 


71221 


II 


(2) 


yziz 


(1) 


72212 


III 


(1) 


ysii 


(2) 


73221 


IV 


(2) 


y4i2 


(1) 


74212 


V 


(1) 


7511 


(2) 


75221 


VI 


(2) 


7612 


(1) 


76212 






etc . 







■which may give res’alts much influenced "by Carry-over, since Carry-over [l] 
is always confounded with direct Treatment effect (l) and [2] with (2). 
Regardless .of the number of repetitions , there are really only U kinds of 
thing, (l) or (2) each preceded by soiue general kind of background and (l) 
and (2) each preceded, by the other. It may be conceived that there obtains 
the model of Equ. (US'! with Carry-over. Then, it Is Immediately apparent, 
bearing in mind Equ. (9) and (U^) that it is required to estimate from the 
above data, with their ij- observations, y , 5 parameters, u , ai , , 

Yi and , but this is impossible. If the least squares estimates are 

attempted, it will be found that there exists no sclutlon for 5i . There 

are too many parameters i'n the model for them to be estimated by 4 things . 
This means, of coiArse, that there is no solution by any method , explicit 

or ptherwise. If one boldly Ignores the possihle Carry— over and estimates 
direct treatment effects, as is usually done by "practical’' menjone gets 
for, say. Treatment (l) 

^^1110 ^2212 ” ^1221 ” ^2120^'^''^ ~ ^1 ~ '~2 ( 226 ) 



so that it is still a mixture of direct Treatment effect and Carry-over. 
Yet this is precisely the est^'mate gotten in a great deal of experimental 
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vork. If, as has keen illustrated and is often the case, [1] and (l) are 
strongly positively correlated such a Design ■will tend to make (l) Judged 
had if it is relatively good and (2) Judged good if it :.s relatively had. 
Such a test is undesirable. The situation is the 'sj’orse because it is 
impossible to distinguish algebraically or arithmetically between direct 
treatment effect and Carry-over. Nor here, does It help a whit to repeat 
the Design, so far as this problem of underdetermination exists. The 
repetition may be very valuable, of course, in estimating extraneous 
variability. 

For Illustration the data of Table V, used previously to Illustrate 
the nature and existence of Cariy-over, may be used in part. For this 
purpose, consider those of the original Week 2 and Week k. This is an 
entirely legitimate type of experiment and often a very good one. It 
is as if a given Treatment were applied for two weeks and an obse 3 rv 8 ±lon 
made in the second Week. In this way any Carry-over in the first Week 
Qp the fortnight is dropped. Also if one is lucky and gets positive 
Carry-over (as actually obtained in this case) the effect of Treatment 
is heightened by the superimposltlon of effect of Cariy-over on that 
of unit Treatment. As can be seen in Table 3QCXIX, it is very clear. 

From Eq,u. (2l6), the estimate of effect of Treatment (l) , without 
allowance for Carry-over is 



?' O 

ERIC 



Yi or (l) - (- 12.6 - 8T.1)/24 

w - 4.154,16 . (22T) 

The estimate of Treatment (2) is then + 4.154,16, as shown In Table XXXDCb. 
If one attemp-te to estimate both Ti jatment and Carry-over from Eq,u. (213)^ 
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one is stopped by the fact that t - 2 = 0 . In the present problem it 
is, of course, impossible to go on to the analysis for effect of Treatment 
when allowajice is made for Carry-oYSr, 

actual analysla shown in Table XXXIXb was gotten by appeal to the 
general program for Youden Designs, as shown in the Appendix. It may, 
however, be profitable to consider the least squares equations underlying 
that , to wit : 



u ai S2 013 “4 “S “6 a? “8 aiO«liai2Sl Yl 1? &2 



Sum 



24 



12 

12 



6 1 



11111111111 



12 



12 

1 



- 1533.7 
1 = 126.9 

1 = 152.5 

1 - 115.9 

1 = 145.8 
1 - 96.0 
1 “ 120.0 
1 = 138.2 
1 = 132,6 
1 = 132.4 

1 125.6 
1 - 126.1 
“ .0 
= 729.6 

6 = 717.0 

^ .0 

6 = 411.3 

11 = .0 



(228) 



(The positions left empty contain zeroes, not shown) 

If now the lines due to consideration of fij and 62 are suppressed the 



equations solve well enough to give the results of Table XXXIXb. If, 
however, the entire matrix is attempted a singularity = Is encountered which 
is but a restatement of the difficulty previously encountered in the con- 
sideration of the number of kinds of things and the number of parameters 
required or again in the Inapplicability of Equ. (213), 
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Table 



O 

ERIC 



YYYTX: - Satisfaction by 2 kinds of Treatmen t over 2 Periods 



12 Groups 
a. Data 



Group 

I 

II 

III 

IV 

V 

VI 

VII 

VIII 

IX 

X 

XI 

XII 



S'uun, 



Week 





2 




1 






Sum 


Diff 


P 


(1) 


56 . 


9 


( 2 ) 


70 . 


0 


126 . 


9 


+13. 


1 


(2) 


75 . 


0 


( 1 ) 


77 . 


5 


152 . 


5 


+ 2. 


5 


(1) 


51 . 


7 


( 2 ) 


61. 


2 


115 . 


9 


+12. 


5 


(2) 


75 . 


C 


( 1 ) 


70 . 


2 


1 I 5 . 


8 


- 5 . 


1 


(1) 


38. 


2 


( 2 ) 


57 . 


8 


96 . 


0 


+19- 


6 


(2) 


19 . 


,1 


( 1 ) 


70 . 


9 


120. 


0 


+21. 


8 


(1) 

( 2 ) 


56 . 

70 . 


,1 

,6 


( 2 ) 

( 1 ) 


81 . 

62 . 


8 

0 


138 . 

132 . 


2 

6 


+ 25 . 

- 8. 


1 

6 


(1) 


62 . 


.7 


( 2 ) 


69 . 


7 


132. 


1 


+ 7 . 


0 


(2) 


67 . 


.8 


( 1 ) 


57 . 


8 


125 . 


6 


-10. 


0 


(1) 


58 . 


.3 


(2) 


67 . 


8 


126 . 


1 


+ 9 . 


5 


(2) 


67 . 


.3 


(1) 


51 . 


,1 


121. 


.7 


-12. 


.9 




729 


. 6 




80 I. 


,1 


1533 . 


.7 


+ 7 I. 


.5 



b. Anakvels for Treatments, without allowance for Carry-over 



(i) (2)^ 

Contr. -1.15 +1.15 

Adj. Mn. 59.75 68.05 



i 


d.f . 


Residual Variability 


Factor f3 


(Squares ) 


p , Rows & Columna (control) 




9I2.I6 


Control factor plus Treatmentsi 10 


528.29 



1,10 



(Q12.16 - 528. 29) /I _ 
528.29/10 
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c. Resu: ;s ~by Treatment and by previous Treatment — a crude 
analy s 1 s 



Treatment 



After 


1 


(1) 






(2) 


[ Sum 

1 

j 


AdJ . 
Mn. 


Contr 


(1) 


1 

1 






70.0 
64.2 
1 57.8 


81.8 

69.7 

67.8 = 


411 . 3 : 4 ll . 3 


61.79 


-5.23 


( 2 ) 


' 7 T -5 
70.2 
70.9 


62.0 
57.8 
5 U .4 = 


392.8 j 
1 


i 

i 

1 




i 392.8 


72.24 


+5.22 


1 

Bk.gr. j 

! 

1 


56.9 
51.7 
1 38.2 


56.4 
62.7 
58.3 = 


1 

324.2 

1 


75.0 
1 75.6 

i 49.1 

1 


70.6 
67.8 
67.3 = 


405.4 729.6 






“ ^ 

Sum j 


1^^ =,6 




-- - 1 

717.0 


1 

1 




816.7 il 533.7 






Adj .Mn. ■ 






57.14 






70.67 


63.90 




Contr . j 






-6.76 i 






+6.77 : 
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It might he ©bjected that the data of Table XXKI)?, from an analysis of 
variance point of view, could be handled by testing against the variability 
among Groups. This could, indeed, be done. It would be eq.ulvalent to 
dropping the elements of in Eq.u. ( 298 ). It would further be precisely 

the thing done in Table XBClXc, The number of degrees of freedom residual 
would be Increased by 11 but generally such procedure would much Inflate 
the mean residual variability. 

If one must teat 2 Treatments in 2 Periods, there could no doubt be 
found various Designs. One that suggests Itself is 



Period 



Unit 


1 2 


I 


(1) 


(2) 


II 


(2) 


(1) 


III 


( 1 ) 


(1) 


IV 


(2) 


(2) 



with perhaps repetition. It is objectionable because it is extravagant with 
experimental material. Units III and IV are devoted entirely to the deter- 
mination of Carry-over which may not exist and if it does, may be of secondary 
Interest. The best thing seems to be to employ Designs of more than 2 
Periods which do work; two such are illustrated in the following discussion. 

In the Design when a previous conditioning Period is Judiciously 
employed the situation is much improved over the foregoing. Say the 
Design and data ares 




Group 


0 


I 


((D) 


(1) 


II 


((2)) 


(2) 


III 


((D) 


(1) 


IV 


((a)) 


(2) 


V 


((D) 


(1) 


VI 


((a)) 


(2) 



Period 



2 

yiiu (2) yi221 
y2122 yz212 

ysill ( 2 ) y 3221 

y4122 (l) y4212 

ysni ( 2 ) ys22i 

y6122 (l) y62l2 

etc. 

3l5 
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■where the model of Eq.u. (43), with allowance for Carry-over again obtains. 
Then yiiii + ysiii + ysili plays the role of yiiii alone, etc., and 
one still has no estimate of direct treatment or carry-over effects. If 
one ignores the Carry-over — and what else can one do? — to simply estimate 
the effect of Treatment (l) by u.aast squares estimate, one gets 

^1 ~ (yilll + 72212 - 71221 “ 72122)/4 (229) 

an estimate of the direct Treatment free of Carry-over. Still one cannot 
solve for in terms of the full model embracing estimates of Rows etc. , 

as previously employed. The problems of the insoluble 2x2x2 are nowise 
solved by repeating the Design to say a 3 (2x2x2). In Table XL there is 
an example of actual results on the model Just discussed. The data were 
gotten by simply cutting the real data from Weeks 1, 2 and 3 from Table V. 
The Groups have been renumbered and the data arranged to manifest the 
basic organization on 4 kinds of observations. 
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Table X 3 > Two Treatments tried Tpy 12 groups In 3 Weeks 
a, PeslKn and Results 



Week 



Group 


0 




1 




2 


Sum 


I 


((D) 


(1) 


56.9 


( 2 ) 


59.4 


116.3 


II 


((D) 


(1) 


51.7 


( 2 ) 


61.7 


113.4 


III 


((D) 


(1) 


38.2 


( 2 ) 


52.7 


90.9 


IV 


((D) 


(D 


56.4 


( 2 ) 


61.8 


118.2 


V 


((D) 


(D 


62.7 


( 2 ) 


68.2 


130.9 


VI 


((D) 


( 1 ) 


58.3 


( 2 ) 


60.7 


119.0 


VII 


((2)) 


(2) 


75-0 


( 1 ) 


72.8 


147.8 


VIII 


((2)) 


( 2 ) 


75.6 


(1) 


71.1 


146.7 


IX 


((a)) 


( 2 ) 


49.1 


( 1 ) 


61.8 


110.9 


X 


((a)) 


( 2 ) 


70.6 


(1) 


60.0 


130.6 


XI 


((2)) 


( 2 ) 


67.8 


(1) 


60 . 0 


127.8 


XII 


((a)) 


( 2 ) 


67.3 


( 1 ) 


67.3 


134.6 


Sum 




729.6 


757.5 


i487.1 


Mean i 






60.8 




63.1 





b. Analysis for direct Treatment alone 

( 1 ) ( 2 ) 

Contr. - 2.20 + 2.20 

Adj. Mn. 59.76 64 . 16 



Factors 


! d. f. 


Residual Variability 
( Squares ) 


U , Rows & Columns (control) 


! 11 


338.13 


Control factors plus Treatment 


i 

! 10 


222.24 



p = ( 338.13 - 222 . 24 ) /I 
1,10 222 . 24/10 



5.21 N.S. 
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-C . _ _ A'V'Sj’.Q-Sgs acoording to Treatment and previous Treatment- 

a crude analysis 



Treatment 



After 


( 1 ) 


( 2 ) 


Mean Contr * 


( 1 ) 


5^.0 


60 . 8 


57. U - 4.6 


( 2 ) 


■ 65.5 


6t.6 


66.5 +U.5 


Mean 

Contr . i 


59.8 

- 2.2 


6 i+.a 

+ 2.2 


62.0 




3J8 
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In Table XLb» a rough result was gotten by ignoring the possible effect 
of Rows and it was precisely this reduction in constants that made solution 
of a sort possible for Treatments and Carries-over . As a practical measure 
for the estimation of effects this device Is not too unsatisfactory, pro- 
vided that there are many Rows. The matter may even be formalized by 
dropping the contrlhutlons in the model and then proceeding with 

least squares equations to a test of significance. Of course, the residual 
variability will consist in large part of that between Groups . This tends 
to be large and so the va l ue of F would probably not be significant. 

As a first example of a 2-treatment Design where the effect of direct 
Treatment and Carry-over can be sepsurated reconsider the data of Table 
Va, which was used to introduce, in a loose and general way, the idea of 
Carry-over and which should now be analyzed more closely. This can be 
done by using the appropriate program for electronic computer as in the 
Appendix, AGCordingly, Table XLI has been formed. It will be seen that 
the significance of Treatments has been somewhat heightened by the intro- 
duction of Carry-over into the model. The latter is significant in its 
own right. 





f 
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Table XLI - Analysis of the data from Table V put in form used elsewhere 
a. Design and results (repeated from Table V) 



V/eek 



Group 


: 0 i 




I 




2 




. 3 




4 


Sum 


I 




(i) 


72.3 


(1) 


5'6.9 


(2) 


59.4 


(2) 


70.0 


; 253,6 


II 


i ((D) i 


(2) 


76.0 


(2) 


75.0 


(1) 


72.8 


(1) 


77.5 


i 301,3 


III 


I ((?)) 


(1) 


61.7 


(1) 


51.7 


(2) 


61.7 


(2) 


64.2 


' 239.3 


IV 


: ((D) i 


(2) 


75.6 


(2) 


75.6 


Cl) 


71.1 


(1) 


70.2 


292.5 


V 


I ((2)) : 


(1) 


36.4 


(1) 


38.2 


(2) 


52.7 


(2) 


57.8 


; 185.1 


VI 


i ((D) i 


(2) 


61.8 


(2) 


49.1 


(1) 


61.8 


(1) 


70.9 


243 . 6 


VII 


i ((D) I 


(1) 


65.5 


(1) 


56.4 


(2) 


61.8 


(2) 


81.8 


: 265.5 


VIII 


: ((D) i 


(2) 


57.8 


(2) 


70,6 


(1) 


60,0 


(1) 


62.0 


250,4 


IX 


i ((2)) i 


(1) 


6o.O 


(1) 


62.7 


(2) 


68.2 


(2) 


69.7 


! 260.6 


X 


i (0-)) ! 


(2) 


68.9 


(2) 


67.8 


(i) 


60.0 


(1) 


57. S 


^ 254.5 


XI 


: ((2)) ! 


(1) 


63.8 


(1) 


58.3 


(2) 


60.7 


(2) 


67.8 


: 250.6 


XII 


, J(D) i 


(2) 


60 , 4 


(2) 


67.3 


(1) 


67.3 


(1) 


54.4 


i 249.4 


Sum 


; I 




760.2 


i 


729.6 




757.5 


804.1 


I 3051.4 


Mean 


I I 

I 




63.4 




60 . 8 




63.1 




67.0 


: 63.6 



b. Anaiysls for Treatments without allowance for Carry-over 





(1) 


(2) 


Contr. 


-2.33 


+ 2.33 


Mean 


61.21 


65.90 



factors 


d.f. 


Residual Variability 
(Squares ) 




y 5 Groups, Weeks (control) 


33 


1419 . 01T5 


A 

■i 

1 


Control factors plus Treatments 


32 


1157.7142 


I 








1 



1,32 



i119.04T5 - Il9l,llk2 
1157 -71^2/32 



7 . 22 * 



A 

I 






o 

ERIC 
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c « Analysis tov Tyea'tmen'bs •with allo'wance for .Carry 



A ^ 





<1) 


(20 


Contr . 


-2.33 


+2.33 


Mean 


61.24 


65.90 




[1] 


[ 2 ] 


Contr . 


-1.82 


+ 1.82 







Residual Varla'blllty 


Fac'bors 


d.f . 


( Squares ) 


p 5 Groups, Weeks, Carries-ov'er (control) 


32 


1259.9067 


Control factors plus Treatments 


31 1 


1 998.5734 






„ ^ 1259.9067 - 998.5734 

1,31 998,573^/31 



8 . 11 ** 



i 




Residual Varlalillty 


Factors 


d.f. 


(Squares ) 


M 5 Groups 5 Weeks 5 Treatments ( control ) 


32 


1157.7142 


Control factors plus Carries-over 


31 


998.5734 



F 



1.31 



1157.7112 - 998.5734 
998.5T34/31 



4. 94* 





over 
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This Design is of curious interest because, Sj oe the effects there 
are entirely orthogonal, it is most convenient and quite legitimate to use 
the conventional analysis of variance,* along the lines indicated earllei 
in connection with the analysis of the latin square. 

It may be of some interest to compare the clear-cut results of Table 
XLIc v-fith those shown earlier in Tables XXXIX and XL, consisting of parts 
of the same data, and subject to crude analysis (without allowance for 
effects oij ) . The earlier data suggested Carry-over agreeing with what 
seems to be the true direction of effect of Treatment. 

As a second example of 2-Treatment experiment designed to deal with 
Carry-over consider the data of Table XLII . Not only is the order of Treat 
ments a little different from that in Table Va but the conditioning week 
here is absent. For convenience of calculation, ti ; results have been 
gathered so that each pattern with its five repetitions is together. This 

*For the model with Treatments but not Carry-over, we get the results: 



Source 1 


1 d»£. 


Sum Square 


Mean Square 


F 


Groups I 


11 


2258.2342 


205.2940 




Waaks 


1 3 


236.8973 


78.9658 


“ 


Traatmants ! 


1 1 


261.3333 


261.3333 


7 , 22 * 


Residual i 


i ■ 


1157.7142 


36.1786 


* * 


Total ! 


1 ^'7 1 


3914.1792 





For the model with Carry-over In addition we get: 



Source 


d. f . 


Sum Square 


Me.an Square | 


F 


Groups 


11 


2258.2342 


‘ ' 1 

1 

205.2940 




Weeks 


3 


236.8975 


78.9658 


... 


Treatments 


1 


261 . 3333 


261 . 3333 


8 . 11 ** 


Carry-over 


1 ^ 


159,1408 


159.1408 


4 . 94* 


Res idual 


31 


998.5734 


32.2120 




Total 


47 


3914.1792 






Design gives data more difficult of analysis than Table Va because direct 
treatment effect and Carry-over are in some degree confoiinded. Plainly 

(1) follows (2) more frequently than It follows itself. Accordingly 
direct treatment effect (l) is confounded in some measure with Carry-over 

[2] while (2) Is in the same measure counfounded with [l] . The 
analysis may be handled by appeal to the program In the Appendix or 
essentially to the least squares Equ. ( 234 ) below. For the model with 
direct treatment effects alone, l.e., without Carry-over, since everything 
is orthogonal, the treatment estimates are simply averages and so are the 
row and coliimn effects . Thus the estimate for y comes from 

80y = 3112 

y = 38.90 (230) 

for Row I from 

4 y + 4 ai = 159 

ai = +.85 . (231) 

For Column 1 from 

20 y + 20 ei - 776 

3l = -.10 (232) 

and for Treatment (l) from 



40 y + 40 yi " 168 

Yi - + 1*3 . ' (233) 

It 5 of course, follows that it may be convenient and quite legitimate to use 
the conventional analysis of variance, along the lines just indicated in 
connection with Table XLI or Indicated earlier in connection with the 
analysis of the latin square. 
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The more involved hut complete analysis consists of fitting hy least 
squares the complete model involving estimates of both Treatments and 
Carries-over * The estlma'te y remains as in Equ. (^30), The estimat^es 
for Colnmn effects remain as prevlouslys i.e.s simple averages. For 
other effects, as in Table XLIl, it is necessary to use the prograjn 
in the Appendix or essentially to employ the least sq^uares e equations as 
follovs : 






y aj '02 0'3 '0,1^. 05 Og 07 'Og O'g s^'ivttisctigO'i 7 'ai 9 ai 9 'a 2 o'Bi Yl Y2 
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nn 

cu 



CO 



csj 

< ^ 



cu ONCM a^Lr^^-c)0 its cn cn o\^ iH cncnro^^ oncnj onjdoo o oj o 

rH c\i pH ltnoj c^co ^ t--- f-- o t--- 

pH I — i pH pH i — I pH pH pH pH i — I i — I pH pH pH pH pH pH i — I pH pH 1 — I 

cn r-HpH 

II If II It II II M II M n II II II II II II II It II II M II II II ii H 

pH I — I pH pH pH pH i — I pH i — I rH 



fH rH 



=( r — 1 pH 
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cn 



pH O 
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O 

eg 
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O 
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pH 






« — I 



pH 




! 1 
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(The positio'ns left empty corf-/ :i zeroes,, not shorn. 



Table Xl.TI - IVo Treatments tried on 2U Groups 



a. Data 



Week 



Group 




1 




2 




3 




4 




Sum 


I 


(1) 


1+0 


(1) 


48 


(2) 


44 


(2) 


27 




159 


II 




36 




44 




32 




30 




142 


III 




34 




37 




24 




34 




129 


IV 




43 




40 




48 




44 




175 


V 




34 = 187 




39 = 208 




42 = 190 




22 


= 157 


137 


VI 


(1) 


39 


(2) 


32 


(1) 


39 


(2) 


38 


I 

i 


l48 


VII 




28 




34 




26 




27 




115 


VIII 




42 




44 




47 




4o 




173 


IX 




48 




38 




49 




38 




173 


X 




35 = 192 




32 = 180 




42 = 203 




40 


1 C 3 


i49 


XI ■ 


(2) 


34 


(1) 


39 


(2) 


38 


(1) 


45 


i 


j 156 


XII ; 




38 




33 




25 




25 




121 


XIII 




32 




36 




40 




45 




153 


XIV 




42 




45 




43 




43 




173 


XV 




42 = l88 




33 ^ 186 




38 = 184 




35 


= 193 


148 


XVI 


(2) 


39 


(2) 


42 


(1) 


47 


(1) 


46 




174 


XVII 




51 




48 




37 




48 




l84 


XVIII 




36 




42 




32 




39 




149 


XIX 




38 




37 




49 




48 




172 


XX ' 




45 = 209 




44 = 213 




47 = 212 




46 


S 227 


182 


Sum 




776 




787 




789 






760 


3112 


Mean 




38.80 




39.35 




39.45 






38.00 




Sum Sq. 


30,694 


31 , 


471 


32, 


349 


30„ 


132 







b. Analysis for Treatments 'without allowance for Carry-over 

(1) (g) 

Contr. +1-30 - 1.30 

Adj, Mn. 1+0.20 3T-60 







Residual Variability 


Factors 


d.f . 


(Squares ) 


+i 5 Rows and Columns ( control ) 


57 


1637.50 


Control factors plus Treatments 


56 


1502.30 



p = 1637.50 - 1502.30 

1,56 1502.30/56 

O 

ERIC 




c. Analysis for Treatments with allowa nc e for Carry-over 



(1) (g) 



Contr . 


+1.61 


-1.61 


Ad j . Mn . 


40.51 


37.29 




A 

[1] 


A 

r2] 


Contr . 


+1.24 


•C\l 

H 

1 



Factors 


d.f . 


Residual Variability 
( Squares ) 


y 5 Rows 5 Colunins & Cai^ry^over 


( control ) 


56 


1613.76 


Control factors plus Treatment 




55 


1425.20 



p ^( 1613.76 - 1 ^ 25 . 20 ) /I 
1,55 1U25.20/55 



7.28** 



Factors 



d.f. 



M , Rows 5 Columns 5 & Treatments ^control) 
Control factors plus Carry-over 



|Resldual Variability 
I ( Squares ) 



1502.10 

1425.20 



F 



1,55 



( 1502.10 - 1425 .20) /I 

1425.20/55 



2.97 N.S. 
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d. Averages according to Treatment and previous Treatrnent- 
a crude analysis 

Treatment 



After i 


U) 


(2) 


Siam 


Ad j . 
Mn . 


Contr . 


(1) I 

i 

j 

1 

i 

i 


£G8 

227 


190 

180 

183 

184 


1172 


39.2 


+ .2 


(2) 


203 

186 

193 

212 


157 

213 


i 

1164 


1 

33.7 


-.3 


f 

Bk . gr . 


18 T 

192 


188 

209 


7T6 






Stim 


1606 


1504 


3112 






Ad j , Mn , 


1 ho. 2 
1 


37.6 




38.9 




Contr . 


1 +1.3 


“1.3 










i, 
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^alygis -AThen ' are 3 Treatments - The smallest Touden rectangle, 

c < t 5 is the Yates Design 3x2x35 l.e,: 




TOUld not work because it involves 8 parameters: 



Rows 

ColiJirans 



1 Tr eat me nx s 2 

2 Carries-Qver 2 
1 



and has but 6 observations. It might be replaced by the type of design 
used I'or paired comparisons with an even value of t ^ i.e. : 



reriod 



Row 


n 




2 


I 


i ^ 

HI 


(2) 


y 




1 1 1 




1221 


II 


(2) y 


•3) 


y 


III 


2 12 

(33 y 


(1) 


y 




3 13 




3213 


IV 


(ij y 


(3) 


y 




4 11 




4231 


V 


(2) y 


(1) 


y 




512 




5212 


VI 


(3) y 


(2) 


y 




613 




6223 



where there are 11 parameters tha,t can be estimated from the 12 obeervations 
This is a Design much used in actual experimental work# 
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Note that we may again find conveniently the differences of 




to find least squares estimates of 



(2Ed. + Ed^ - 1202 )/3 



(235) 



6, = Ed. + Ed! - 83? 

K 1 1 ^ J 

as special cases of Equ. (213). It may even 'be said that in the models 
without consideration of Carry-overs when from Equ. (215) 



the structure Is so simple that Equ- (176), as in connection with Table 
XXXII on the 2( 3x2x3), can be so simplified. 



a paired Design, involving more than. 2 Treatments, where the variability 
among Treatments must be broken up, just as it was previously for Youdens 
in general or for latin squares. An example of such an experiment 
was provided by the data of Table X3DCI on a 9xtxl8. The Treatments 
there consisted of 3 variables each at 2 levels (a high value and a low 
value). Similarly if one had a s^udy where the technique of trial was 
by each subject making a single Change-over, but there were involved 9 
Treatments the best procedure would be to work with the treatment estimates 
very much as in the more simple problem of the latin square i one works 
with totals and then finally adjusts mean squares in allowance for scale# 
One would start with the treatment estimates and they would be colleeted, 
as the nature of the question dictated. To those who have followed the 
earlier discussion there will be no problem. 



= (Ed - Ed' )/6 



( 236 ) 




There may easily be a situation in 
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Missing data situations on paired Designs - In the extreme situation of 
hut a single Change-over, there can he no question of there being a missing 
cell. If a participant has only been subject to one Treatment no 



compa,rison can he formed for any other Treatment and the single observation 
is dropped. On the other, hand, it may happen that certain pairs are lost 
and it la impossible to replace them. So in the second sense there may be 
missing data. 

There are 5 indeedg certain cases where comparisons are deinbei^rately 
omitted. Thus, if the number of Treatments is very great c| may be 
excessive and fewer comparisons must be made. Such Designs are discussed 
by Cox ( 1958 ) who gives for 7 Treatments and 1+ appearances (replicates 
he calls them) of eacl the Design as follows: 



^ vs * 


(2) 


(5) 


VS - 


(6) 


(1) 


vs 


. (3) 


(5) 


vs , 


(7) 


' vs . 


(3) 


(6) 


vs . 


(7) 


(2) 


vs 


. (4) 


(1) 


vs . 


(6) 


VS • 


(4) 


■ (?) 


VS * 


(1) 


(3) 


vs 


. (5) 


(2) 


vs . 


(7) 


vs * 


(5) 








(4) 


vs 


. (6) 






tliis 


is ( 


3onsidered i 


the 


form of 


' a 


comparir 


‘on table 


one gets; 




where certain comparisons, such as (l) with (2), are direct and intimate 
whereas others like (l) with (4) are indirect. This situation Is really 
Just a special case of situations discussed in the previous chapter under 
the topic of Designs more or less Youden. 





As a simple, although somewhat trivial, illustration of the situation, 
there has been formed Tu^le XLIII by simply taking the Design and data for 
the first 1„ hows of Trble XXXVII. In the terms of Cox (1958) » this is 6 



Treatments in U appearances with the additional condition that each 
Treatment occur twice and twice only in each Colmnn. He was not, of 
concerned with Change-over. It is possible to set up least squares i 
as previously, or else simply to use the program, as in the Appendix 
results are that 

P = 73.1/24 
= 3.0 

and other reSTalts are shown in the table* 



course , 
quations 
The 
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Table XLIII - Incomplete comparison of 6 Treatm ents 
sl . Data 



Period 



Group 




1 




2 


Syim 


I 


0.) 


3.0 


(2) 


2.7 


5.7 


II 


(2) 


3.0 


(3) 


3.3 


6.3 


III 


i (3) 


2.6 


(4) 


3.0 


5.6 


IV 


! (4) 


3-3 


(5) 


3.0 


6 . 3 


V ■ 


! (5) 


3.1 


(6) 


2.7 


5.8 


VI 


j (6) 


3.0 


(1) 


2.9 


5.9 


VII 


(1) 


3.1 


(3) 


2.8 


5-9 


VIII ! 


(2) 


3.2 


(4) 


2.7 


5.9 


IX ! 


1 (3) 


2.1 


(5) 


2.8 


4.9 


1 

X ! 


j (4) 


2.9 


(6) 


3.4 


6.3 


XI 


( 5 ) 


3.5 


(1) 


3-5 ^ 


7.0 


XII 


(6) 


3.7 


(2) 


3.8 


7-5 


Sijm 

( 




36.5 




36.6 


73.1 



b. Analysis for Treatments without allowance for Carry-over 

(1) (2) (3) (U) (5) ih 
Contr . +.1 — .0 -.2 -.1 +.2 +-1 
Ad J .Mn. 3.1 3-0 2.8 2.9 3.2 3.1 



Factors 

y i Rows & Colunms (control) 
Control factors plus Treatments 



d.f . 



Residual Variability 
(Squares ) 




. 81 * 

.60 



w - ( > 84 - . 6o ) /5 

^5,6 “ .60/6 



.48 N.S. 





c. Analysis for Treatment with allowance for Carry-over 

( 1 ) (a) (3) (4) (5) 

Contr . +.4 +.4 +.3 ~*5 

Ad J , Mn . 3-4 3.4 3.3 2.3 2.5 



ri] [2] rji [4] [j] [61 

Contr. -.3 +.5 +1-4 -.4 -1.0 -.3 



+ .1 
3.1 



• Residual Variability 

B^actors ; C Squares ) 

U 5 Rows, Colirnns & Carrles-over (control); ^ | *39 

Control factors plus Treatments j 1 : -03 



^ (.39 - ■03)/5 
^5,1 -03/1 



2.12 N.S. 
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Although EX'.ch design gives completely legitimate estimates of treat 
ment effect and of their signlficaaice no Ingenuity can altogether surmount 
the various degrees of intimacy -with vhich the comparisons are made, fhe 

difficulties show up when one attempts any partition of the variability. 

% 

Double reversal trials - Perhaps there should be briefly mentioned a class 
of Design closely related to those treated in the present chapter, i.e., 
the double reversal trial. It Is used to some extent in Animal Husbandry 
and is honored by a chapter in Lucas (1969) • In the symbolism of the 
present book it takes the form 



Period 



Cov/ 




1 


2 




J 


I 


( 1 ) 


yi 11 


(2) 11221 


( 1 ) 


11312 


II i 
1 


i (2) 


1212 


( I ) 12212 


(2) 


12321 


III 1 


|u) 


1311 


(2) 13221 


(1) 


13312 


IV I 


: (2) 


1412 


(l) 14212 


(2) 


14321 


V 


i 


1511 


(2) y5221 


(1) 


15312 


VI 


i (2) 


1612 


(l) 16212 


(2) 


16321 



O 
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The study is based essentially on differences oi the type yiii yi312 
- 2(yi-j9i) • It is argued that insofar - the effect of time is linear such 
a coinparlson is free of the effects of Period . Indeed it is. It may 
further be argued that insofar as such a trend is peculiar to a givei:i unit 
(Cow) the elimination of treiid is slnillarly peculiar. There is no c-ssump 
tlon as in all the work of the present book, that trend is common to all 
units, or perhaps more fairly that trend, linear or otherwise, is eliminated 
so "ar as it is common to all units. The rub remains that the effect of 
Treatments and Carries-over is completely confounded, so the Design seems 
ill-suited to our purposes. Furthermore, it does not generalize to 
louden rectangl s and latin squares. . 



IX. Epilogue- -r^i iS fill 



Page 

The general problem of mis fill 55 

Under-fill in two categories 557 

Under-fill in more than two categories ... 

Over™ f ill 




3dS 



VJ1' 
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The general problem of misfill - The preceding discussion has frequently 
skirted problems when in some sense there are missing data. This matter 
will be now considered extensively. Looking at the matter in a general 
way, let us call the problem one of misfill. This will Include under-fill, 
as frequently discussed in the literature, o^^or-flll which does not seem 
to be discussed and a mixtinre of the two. Fill problems may occur for 
three reasons. First thei-e is the classical reason that some data have been 
lost or it has proven impossible to complete the Design. Such a case is 
illustrated below for the experiinent , previously presented, for Oils on a 
Machine where one of the Machines may be bupposed to fail. Gecondly, the 
situation may be such that it is physically impossible to complete the 
Design. An example. Table XLVIII, is shown where it is impossible (bearing 
Ir mind other experimental necessities) to write a Design where Carry-over 
is properly balanced against Rows. Thirdly, an incorrect fill may be 
deliberately created bBoause it is more convenient than some other exper- 
imental measure. An example previously shown is that of more— or— less 
Youden situations where a Youden rectangle was deliberately not completed. 

The term "fill" is used in the sense of the previous discussion, i.e., 
the number of times that a Treatment is compared with others in the same 
Row. Then a misfill will mean that some comparisons are made more or less 
often than others rather than the same number of times for all comparisons, 
as in a proper Youden Design. Using the concept in a more extensive way, 
misfill may be conceived to cover any situation which may be thought of as 
falling short of some balanced, orthogonal Design. 




The discussion in the literature on what is called missing data is what 
is here termed under-fill. It is mainly, or perhaps exclusively, concerned 
with a Design where certain scattered cells are missing. In a general way, 
for any 2-factor problem it is in rows and columns for each of which there 
occur at least 2 observations. This problem will be considered. In a 
more extensive and very common way there may be more than 2 factors and 
whole Rows or Columns may be missing. For instance, a Youden rectangle 
might be considered perfect if It were as called for, say, in 
Table XIII. Then the data of Table XXIX is a case of missing data. All 
k observations of the Row 

(T) (8) (10) (2) (6) 

and of Row 

(11) (1) (3) (6) (10) 

are, in a sense, missing. 

The case of the data of Table XXXIV may be considered as a situation 
where the patterns 



XIV 


(1) 


(2) 


(i*) 


(7) 


XV 


(2) 


(3) 


(5) 


(1) 


XVII 


ik) 


(5) 


(7) 


(3) 


XVIII 


(6) 


(7) 


(2) 


(5) 



are excessive. There if one attempts a single Youden repeated thrice but 
is unable to complete the 3rd repetition, he may regard the result as an 
over-fill of a repetition twice or an under-fill of thrice. If, In fact, 
very little of the 3^d repetition gets done it is natural to fall back 
on the twice position. Indeed, at times it becomes a matter of view-point 
whether a table is under-filled or over-filled. Over-fill can be analysed 
just as easily as under-fill and by the same general methods. The liter- 




ature seems to say, however, noohing on the matter. 
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We can even entertain situations where the number of items is right 
but they are in the wrong places. Table XLVIIl is a situation where such 
is the case. Most cells are filled oncej but some are filled twice and as 
many not at all. It Is, indeed, a comfortable position to regard all 
problems of the present types as special cases of misfill. 

To some extent, the q.uestlon of misfill is a matter of view-point. 

The perfect and complete Youden rectangles, themselves, may, as was discussed 
in Chap. Ill, on exploration of the Youden field, be regarded as misfllled — 
incomplete latin sc^uares as it is put in the literature. They do not result 
in tidy tables with all cells filled and which provide estimates by way of 
marginal totals. An effort Is then made to misfill or under-fill discretely. 
Whatever the case, it remains an experimental objective to arrange matters 
so that the categories are as far asi possible non— conflicting or orthogonal. 
If they are not so one cannot distinguish their effects. As it turns out 
these equations can, as discussed in Chap, V, be very easily solved to give 
convenient solutions for treatment effects and procedures for analysis that 
are easily possible of application. The present discusalon is concerned 
with the possibility of solution. A good Design should be as easy as 
possible of solution. 

Under-fill In two categories - Very often some Item may be lost in a 
table of 2— way clasBificatlon , such as Table XLIV, shown below. It may be 

said, otherwise, that some cell is missing. Such a situation is often 
called one of missing data. Let us, however , call it an under-fill. Such 
situations or problems may occur for three reasons . First there is the 
classical reason tha,t some data have been lost or It has proven impossible 








to complete the Design. Such a case is illustrated helov in Table XLIV. 
Secondly 5 the situation may be such that it is physically impossible to 
complete the design such as when it is logically or design-wise impossible 
to get a complete Design for the study of Carry-over, This problem will 
be discussed in the following chapter on Carry— over. Thirdly, an incorrect 
fill may be deliberately created because it is more convenient tharx some 
other experimental measiire. A Design may be almost balanced but a cell or 
two is missing. Natirrally such a Design gives almost the same Information 
as the complete situation but it is difficult of analysis. Regardless of 
the occasloii, we must estimate our effects correctly, l.e., the first power 
or average effects, regardless of the omissions. In a theoretical way we 
may have to make an analysis of significance correctly, l.e., do our second 
power arithmetic of squares, correctly in spite of handicap. With this 
aspect, however, the present chapter will not concern itself. 

Situations, where cells are missing, can be handled by the techniques 
of missing data that are co mm onplace In the literature. They, on the 
whole, are unsatisfactory ; apparently the writers have done little to apply 
them and are imaware of the law efficiency of the methods. Much better can 
be done and the subject merits a full and general discussion. 

The principal practical use of mlBsing data theory, in the context 
of the present book. Is in the forming of unbiased estlimtes. The deter- 
mination of Bignificance is little involved. A fairly typical problem 
is shown In Table XLIV, There is given a statement of satisfaction by 
each of 11 Men when they were given 6 kinds of Treatment . Each kind was 
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given out to all 11 Men in a given Week. The practical problem is to form 
an estimate of what degree of satisfaction was gotten for each Product-Week. 
In this table the confounding of Weeks with Treatments is complete. This 
situation is, of course, simple because there are then only 2 real 
categories. Each Week, however, some Men were missing. Accordingly, the 
observed Means , as shown at the foot of the table were somewhat disturbed 
by the actual person missing. It is possible to make estimates of Adjusted 
Means freed of this handicap, as are also shown at the foot of the table. 
They should, and do, contain less extraneous variability. It can be seen 
from the above how different are the results with Men missing and with 
unbiased estimates where allowance is made for those misses . 

In a situation such as that of Table XLIV, one might assume a very 
simple model. 



where the elements have the same meaning as in earlier,' more elaborate cases, 
and then set up least squares equations as follows : 




(238) 





3^0 



M ai «2 “3 “4 «5 «6 “7 «8 “9 ^lo an $2 ^3 ^4 3s @6 “ Sum 



55 6 
6 6 
6 
3 
k 
6 
6 
k 



1 

9 

10 
9 
8 

9 

10 



1 



3 k 



1 



-1 

-1 -1 
-1 



6 h 6 



1111111 



-1 

-1 



. 1 
-1 
-1 

-1 

-1 



9 10 9 8 9 10 



-1 



-1 -1 
-1 -1 



9 . 



10 



111111 



(The posltionsj left empty, contain zeroes, not shown) 



1 U 2 

14 

13 

13 

9 

16 

11 

8 

22 

18 

12 

0 



19 

26 

0 
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It is, however, generally more practical to use a simple Iterative approach. 
The one recommended is shown in detail in Tahle XLIV. This Iterative pro- 
cedure is algehralcally equivalent to settling -up least squares equations for 
M and the two categories are solving. It is, however, often convenient to 
carry out this simple procedure on a desk calculator. Even If it is assigned 
to an electronic computer, it may he quicker and cheaper to mechanize the 
iteration than to have the machine set up equations and then solve. 

In the calculation of Tahle XLIV, all that is Involved is eSBentlally 
the iterative solution of the 3 aquations for p , Men and Product-Week. 

As the prohlem was actually worked the steps were as follows : 



O 

ERIC 



342 



3^1 



a. Form means of Eows . For Row III, thus, get 13/3 = U.3* For 
full Rows the means are also needed. 

b. Form the right-hand corner mean as the mean of the Row means, 
including the complete Rows , 

c. Find the contribution of each Row (only those incomplete are 
needed). Thus for Row III, the contribution is 4.3 - 2.7 - + 1.6. 

d. Form adjusted Column sums by adding for each the contributions 

of the missing Rows. Thus for Column (l) get 26 + 1.6 + .3 - 27. 9- 
Divide this adjusted sum by the number of items actually In the 
Column to get adjusted mean. Thus for Col umn (l) get 27.9/9 = 3.1. 

e. Form new adjusted corner mean as the mean of the Row means, 
including any complete Columns. 

f. Find the contribution of each Column (only those incomplete are 
needed). Thus for Column (l), the contribution is 3.1 “ ?*7 ~ + -4. 

g. Form second adjusted Row sum by adding for each the contribu- 
tion of the missing Columns, Thus for Row III get 13+ .4- .1+ .3 =13.6. 
1 ivlde this adjusted sum by the number of items actually in the 

Row to get adjusted mean. Thus for Row III get 13.6/3 = 4.5. 

h. Form new adjusted corner mean as the mean of 2^*^ adjusted Row 
means, including any complete Rows. 

I. Find the contributions of each Row ( only those incomplete are 

needed). Thus for Row III, the contribution is 4.5 - 2,7 - 1.8. 

J. Return to step d. Continue moving . focm Rows to Colianns to Rows 
etc. until the adjusted mean is unchanged from the last step. 

k. The Column means, which are the result wanted in the present case 
are then read from the foot of the total. 
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Table XblV •- Satisfaction by Men and Treatments "with missing cells 



Recommended Iterative solution 
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The procedure usually recommended in the literature for this situation 
involves filling the missing cells with estimates of what the observations 
might have ■been and then proceeding to the formation of Row and Column 
means and contributions. The details of ealculation are shown in Table XLV. 
There the cells of missing data are filled with italicized values which 
are the product of calculatiori , as immediately below. The essential dif- 
ference between these two procedures is that in Table XLIV the effort is 
concentrated on the formation of corner? row and coluinn estimates? whereas 
In Table XLV it is on the formation of cell estimates. From Table XLIV the 
cell estimates could be foiind as a by-product while in Table XLV the row and 
coluinn estimates are found as a by-product. 




345 



344 



The steps in calculating Table XLV are as follows : 

in each missing cell with some guess as to its proper value. 
These guesses may be a single number or various numbers . For 
the sake of illastration suppose they are all filled In with the 
observed overall mean 142/55 " 2 . 6 . 

Form row, column and corner means. For corner mean get 
{i 42 + 11(2.6)}/66 - 2.6. For Row III get {l3 + 3(2.6)}/6 = 3.5. 
For this Row the contribution is 3.5 — 2.6 = . 9 . For Column 1 

get {26 + 2 ( 2 . 6 )}/ll = 2.8. For this Colimin the contribution is 

2 . 8 - 2 . 6 =+. 2 . 

Rsform the estimate of missing values as corner average plus row 
and Column contributions. Thus for the missing value in Row III 
and Column 1 , get 2.7 + .9 + .2 = 3.8. 

When all 11 missing values have been so reformed, repeat the 
operation to find that now the contribution of Row III is + ]!..4 
(s-s in Table XLV ) , for Column 1 is + ,4 and these superimposed 
upon a corner mean which is still 2.6 gives a second reformed 
value for the first missing value of 2,6 + 1.4 - .4 = 3.6. So 
proceed until the matter settles down. 




Table XI.V - Satisfaction by Men and Treatments with missing cells - Iterative 



solution, not recoininended 



Man 


( 1 ) 


( 2 ) 


Week 

(3^ (it) 


(5) 


( 6 ) 


Sum 


ist 

AdJ . Con- 
Mn. tr . 


gnd 

AdJ . Con- 
Mn. tr. 


3 rd ! 

AdJ . Con- ; 
Mn. tr . j 


1 j^th 

AdJ . Con- 
Mn. tr. 


1 ^th 

1 AdJ . Con- 
! Mn. tr. 


! 

'AdJ. 
■ Mn. 


I 


3 


1 


3 


3 


2 


2 


14 


2.3 




■ ~l 


1=^ — 


1 

i 


1 


ri 


2 


2 


2 


2 


2 


3 


13 


2.2 








i 

i 




III 


U ,8 


5 


it 


ka ki 


4 


13 


3.5 +.9 


4.0 +1.4 


4.3 + 1.7 


4.4 + 1.7 


|4.5 + 1.8 


4.5 


IV 


3 


1 


2 ^ 


2.2 


3 


2 


9 


2.4 -.2 


2.3 - .3 


2.3 - .3 


2.3 - .4 


!2.3 - .4 


2.3 


/ 


It 


3 


2 


3 


4 


0 


16 


2.T 








1 


i 


IT 


2 


1 


2 


2 


2 


2 


11 


1.8 












111 


2 


2 


2 


2 


2.3 


1.2 


8 


2.2 -.4 


2.0 - .6 


2.0 - .6 


2.0 - .7 


I 1.9 - .8 


1.9 


111! 


k 


5 


5 


3 


5 


0 


22 


3.T 












EX 


3 


3 


3 


3 


3 


3 


l8 


3.0 














3 


2 


3 


1 


2 


1 


12 


2.0 












Cl 


3.? 


2.9 


hJ 


3.0 


3 


3 


6 


2.7 +.1 


2.8 + .2 


3.0 + .4 


3.1 + .4 


3.1 + ,4 


3.1 


5um 


26 


2? 


26 


19 


26 


20 


l42 




1 








idj .Mn 


2.8 


2.5 


2.8 


2. it 


2.8 


2.1 




2.6 








j 




lontr 


+ .2 


-.1 


+ .2 


-.2 


+ .2 


-.5 












1 




idj .Mn 


3.0 


2.5 


2.9 


2.5 


2.9 


2.0 






2.6 










iontr 


+ .lt 


-.1 


+ .3 


-.1 


+ .3 


-.6 
















.d j . Mn 


3.1 


2.5 


2.9 


2.5 


3.0 


1.9 






:2.6 








'ontr 


+.5 


-.1 


+ .3 


-.1 


+ .4 


-.7 
















.d j * Mn 


3.1 


2.5 


2.9 


2.6 


3.0 


1.9 










2.7 






'ontr 


+. it 


-.2 


*-.2 


-.1 


+.3 


-.8 ; 
















dj .Mn ! 


3.1 


2.5 


2.9 


2.6 


3.0 


1.9 












2.7 




ontr 


+ .it 


-.2 


+ .2 


-.1 


+ .3 


-.8 
















■ dj .Mn 


3.1 


2.5 


2.9 


2.6 


3.0 


1.9 , 










1 


2.7 
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It may lae observed that this method takes 5 Iterations in contrast 
to the 2 Iterations of Table XLIV. Furthermore, the formation of the cell 
values is very troublesome, so that there is almost t-wioe the work for a 
given iteration. All in all, the work of Table XLV is about 10 times that 
of Table XLIV and such a ratio is fairly typical. It will he noted that 
the results In the two tables differ slightly and this because those In 
Table XLV are, within the bounds of ro-unding error, dependent on the 
number, or niombers , with which the missing cells are filled at first 
approximation. If we had started hy filling each with a large number , 
like 5.0 Instead of 2.6, the contrlhutions in Table XLV would have heen 
a little hi^er. We can only sum up the procedure of filling missing cells 
by saying that an extremely heavy sacrifice, is made for the sake of the 
orthogonal point of view. The filling is essentially done to make the 
data orthogonal. This is of a piece •j'ith the forcing of tests of signif- 
icance into the analysis of varian,ce . 

It Is, of course, poBsihle to test significance of the treatment 
effects in Table XLIV; it is indeed commonly done in the literature. Such 
experiments are, however, somewhat outside the field of the present book and 
so the matter will not he pursued further. 

One place where under-fill in two categories arises very naturally 
and is employed frequently. In work of the present kind, is in the quick 
examination of data to see whether there is any indication of Cariy-over. 

For example, the latln square of Table XXIV may be examined in this way 
as in Table XLVI, Data are arranged according to Treatment and preceding 
Treatment so that averages may he found quickly. In this Design, with 
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conditioning Period, the only oomplicatlon arises from the missing 
ow of the pel feet Design, It is perhaps wisest to find adjusted means 
y iteration. They are plainly a little different from the simple means. 

11 such analysis is, of course, incomplete because no allowance is made 
or the slight confounding of Cariy-over with Row. 

Note that u is subject to constant estimation as the Iteration 
roceeds , because the losses are identified with certain Treatments and 
anries— over . It may be estimated as the average of treatment averages or, 
t an appropriate stage, of canry-over averages. 

In case the calculation of Table XLVI is not immediately apparent, 
t may be sketched, first, from the after means 51*4, 54.1 etc.; the first 
stimate of y is their average, l.e., 55*5. The first estimates of after 
ontrlbutlons are 51.4 - 55-5 = -4.1 etc. The latter are used to adjust 
he treatment totals. Thus for Treatment (l) the Siam becomes 264.8 + (- 1.4) 
263 . 4 . The first estimate of mean fer thia Treatment then is 263.4/5 - 52.? 
he estimate of y as the average of the values 52. T» 51.0 etc. happens to 
eraaln at 55.5- The contributions are 52.? - 55.5 = ~ 2.8 etc. The latter 
alues are now used to adjust the after averages. Thus after (2) becomes 
2?0.6 + (- 2,8)}/5 = 53 . 6 . The business is pursued until ccntrlbutions for 
Ither After or Treatinent stabilise. Note that the actual means for Treatments 
ave been added for the sake of comparison. 
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?able XLVI - Data from Table XXIV» an incomplete latin square, with condition- 
ing Period examined quickly for evidence of Carry-over 




I 

I 

?- 
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As another example of an -ander-fill situation that arises in 
considering results hy Treatment and preceding Treatment, there are the 
data of Tahle XXIII, as examined in tahle XLVII. In this Desl^, without 
a conditioning Period, the cells on the principal diagonal are necessarily 
unfilled and It is again wisest to find adjusted mean by iteration. They 
are plainly a little different from the simple means. This under-fill 
arises not from some data ha-ving been somehow lost or ungotten, but rather 
from the logical difficulties of the Design, In such tables, where the 
results are classified by Treatment and after Treatment, one has in a very 
direct way simply an example of incomplete fill. 





An importan-u point that seems difficult is that horizontally the 
last line is not involved hut vertically it is. This may be called the 
mixed model that arises in unconditioned experiments. Accordingly, the 
quantity on 'Which one is zero>centering 'varies according to the direction 
of interest. The value, be it the 52.0 horizontally, or the 53.0 vertically 
is set once and for all as the average of appropriate observations , because 
the omission of direct Treatment effects and of CarrieB— over is that of 
the complete set. 

in ease the calculation of Table XLVII is not Immediately apparent, it 
may be sketched. First, form the af-ter means 53.3, 53.9 etc. In order to 
zero-center them, find their average of 52.0. The first estimates of 
after contributions are 53.3 - 52.0 « + 1.3 etc. The latter are used to 
adjust the treatment totals (■which Include the data of the first experimental 
Period, l.e., background obaervatlons 56.8, 57.8 etc.). Thus for Treatment 
(1) the mean becomes {208.0 + (+ 1.3)>/h - 52-3. In order to zero-center 
them, find their average which is now 53.0. The contributions are 
52.3 - 53.0 = - .7 etc. The latter values are now used to adjust the after 
averages. Thus after (l) becomaa {159.8 + (- .7)}/3 = 53-0. Such values 
are again zero-centered. Note that the actual means for Treatments have 
been added foP the sake of co^panison# 
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Table XLVII - Data of Table 3QC1II sxajiiined quickly for evidence of Carry-over 



In a latln, square without conditioning Period 



After 


(1) 


Treatment 
(2) (3) 


(4) 


Sum 


Mn. 


Contr 


a 

AdJ . 

. 


Contr 


AdJ . 
Mn. 


(1) 




57.2 


54.0 


48.6 


159.8 


53.3 


+ 1.3 


' 53.0 


+ 1.0 


53.0 


(£) 


52.2 




54.6 


54.8 


161.6 


53.9 


+ 1.9 


54.3 


+ 2.3 


54.3 


(3) 


4?.o 


50.6 




53.0 


150.6 


50.2 


-i.a; 


50.6 


- 1.4 


i50.6 


(U) 


52.0 


k9.k 


50.6 




152.0 


50.6 


-1.4; 


50.1 


- 1 . 9 : 


’ 50.1 


Bk , Gr ^ 


56.8 


57.8 


59.2 


50.4 


224.2 












Mean 


52.0 


53.8 


54.6 


51.7 














Sum 


208.0 


215.0 


218.4 


2o6.8 


848.2 












AdJ .Mn 


52,3 


54.2 


54.2 


51.4 




52.0 










Contr 


- -7 


+1.2 


+1.2 


-1.6 




53.0 










AdJ .Mn 


52. P 


54.3 


54.2 


51.2 








52,0 


i 

i 




Contr 


-.8 


+1.3 


+1.2 


-1.8 






1 53.0 








1 \ 




The techniq,ue Just Illustrated in Table XLVII works ill for Youdans , 
particular* ly if c Is much less than t . Such a case was that shown in 
Table XXIId. In the first place the iteration is very slow because the 
table is so incompletely filled and in the second place because not only 
is Carry-over confounded with Row but it Is confounded irith the same Row 
as its Treatment, counterpart. 

Under-fill In more than two categories - Problems, analogous to those of 
Tables XLIV through XLVII, i.e., under-filled situations, are in 3 categories, 
say Men, Periods and Treatments, for complete and satisfactory solution, 
if one Is simply after the analysis for direct treatment effects. The 
situation with 2 cells missing as previously shown in Table XXV, for example, 
cannot conveniently be handled by forming mar'ginal totals, adjusted totals 
etc. with Rows, Columns and Treatments to consider. This hecause we lack 
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3-dimensional paper. It is perhaps best to do it essentially by setting up 

the least squares equations and solving them iteratively, if it must be 

done on a desk calculator, but it does not seem 'worthwhile to illustrate 
the matter. If one is after Carry-over also^ 4 categories are involved. 

If one so cared^he might set up the various equations and solve them 
iteratively. We used to do such things but now rejoice in the progress of 
our times — it was dreadful. When the Design is Inooinplete by certain full 
Rows the procedure is exactly the samej the programs In the Appendix may 
be used. 

As one of the many eJiamples of the type of problem involved there 
are the data of Table XXIII. As can be seen from the rough analysis as in 
Table XXIIIb the estimation for Carry— over is complicated by the fact that 
the Design is incompletely filled with observations. Let us say tiiat 
the Design Is essentially a matter of effects of various kinds such as 
direct treatment effects and Carry-over „ appearing an equal number of times 
in all combinations but for various practical reasons, this objective is 
not attained. 

f 

The procedure. Just indicated, also becomes Intolerable if one 
attempts to extend it to a Youden rectangle c < t with or without 
Carry-over , 

Oi^r-fill - We shall encounter the problem of over- fill as well as missing 
data or under-fill, although the literature seems silent on the subject. 

No doubt such may happen in many ways or many situations may he so viewed. 
Let us coAfine our attention to a case when this Is not due to accident 

®^^S®HGles of design. The over— fill is not to be due to accident but to 
the fact that it is logically impossible to write a Design when the cells 
are evenly filled. An example is provided by the consideration of 
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Carry-over effect against Blocks in the data of Table VI j as shown in Table 

XLVIII. This is an entirely legitimate question because Treatments are ortho 

to both oth'-r effects and we might choose to clear them of one another. 

The results would be final and lAnembarrassed. It will be seen that on the 

principal diagonal the positions are double— filled, while on the secondary 

diagonal they are empty. One might say so or say that the table is 

filled twice although in most cells one observation is missing and in some 

both. Thus while the contribution of Cariy-over [6] may be influenced one 

way because Group I is missing it may also b5 affected because Group VI 

is present twice. We may say the Design is under-filled (missing plot) 

or over— filled or in general, mlsfllled. Both under— and over— filling 

aspects occur In this single experiinent . 

The required estimates can be gotten by an Iterative technique similar 

to that recommended for under— filled or missing data situations. The 

sum for each Row or Coliimn, sucGessively , is adjusted for the contributions 

that it lacks but also now for those that it has excessively , an average 

struck and contributions found. One comes out with adjusted averages 

for Groups and Carry-over. In the present case they are changed from the 

direct averages that one gets . The details of iteration are as follows , 

They are started by finding the simple row means, the corner mean ^Sth 

and from these a Just approximation to the row contributions . The first 

adjusted column means were found by iriaklng allowance for these first 

row contributions. Thus the mean for Carry-over [l] la 

{308,6 - (- 3.6) + 5 . 4}/6 = 52.9. The corner average remains unchanged in 
a perfectly balanced misfill of this kind. The colxmn contributions 

O 

me 
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wepe tli©n foujid. and. ussd to get a second estimate of row mean and contnitu— 
tlon. Thus for Group I the estimate becomes { 317.0 - ( - 3.5) + 1.3}/6 = 536 
Means stabilise by the 3rd iteration of the row means. Of course, in 
practice one does not usually write down the sucGessl've iterations but 
simply writes them in pencil and uses India rubber. 

regards a missing data situation as a matter of trying to 
replace the bit of data, one cannot handle bhe idea of over-fill at 
all. One would have to fall back on the concept of the table's being 
filled twice In each cell but with half the values, i.e., 36 of them, 
missing. One would have to put In 36 estimates, strike averages, return 
to Improve the 36 estimates etc. The operation woTild be monstrous. 
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XLVIII - Carry-over ap;ainst Group from the data of Table VI . 

an example of over-fill 









Cam 


1 ^ 
0 












a‘ 




3. a 




Group 


[1] 


[2] 


[3] 


[4] 


[5] 


[6] 


Sum 


Mn. 


Contr 


Adj. 

Mn. 


Contr 


Adj . 
Mn. 


Contr 


Ad j . 
Mn. 


I 


h 6 ,k 

45.8 


4o.8 


62.4 


59.9 


61.7 




317.0 


52.8 


--3-6 


153.6 

j 

i 

j* 


-2.8 


53.7 


-2.7 


53.7 


II 


58.4 


50.0 

50.0 


53.3 


64.2 




60.9 


336.8 


1 56,1 

1 


- .3 


1 

j57.5 

i 


+ 1,1 . 


57.7 


+1.3 


57,7 


III 


52.0 


64.2 


60.9 

59.2 




55.3 


44.9 


336.5 


56.1 


- .3 


55.8 


- * 6 : 


55.8 


-- , 6 


55.8 


IV 


56.4 


65.6 




48.8 

50.4 


58.9 


64.2 


344.3 


57.4 


+1.0 


57.6 


+1,2 


57.7 


+1.3 


57.7 


V 


49.6 




51.8 


53.6 


63.2 

58.7 


49.6 


326.5 


54.4 


-2.0 


53.0 


-3.4 


52.9 


-3.5 


52.9 


VI 




52.7 


53.3 


57.3 


71.7 


63.7 

72.0 


370.7 


61.8 


+5.4 


61.0 


+4.6 1 


60.9 


+4.5 


60.9 


Mean 

Smi 


51.4 

308.6 


53.9 

323.3 


56.8 55.7 61.6 
340.9 334.2 369.5 


59.2 

355.3 


2031.8 


56.4 




Ad J , Mn 
Contr 


52.9 

-3.5 


53.6 

-2.6 


57.0 
+ , 6 


55.5 
- .9 


61.9 

+5.5 


57.7 

+1.3 








Adj .Mn 
Contr 


52.7 

-3.7 


53.1 

-3.3 


57.1 
+ .7 


55.4 

- 1.0 


62.3 

+5.9 


58.0 

+ 1.6 








AdJ.Mn 

Contr 


52.6 

-3.8 


53.1 

- 3.3 


57.1 

+ .7 


55.4 

- 1.0 


62.4 
+6 . 0 


58.0 

+1.6 
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Table L. Variance ratio for 5%» 1% and .1% levels according to freedom 
of denominator and numerator. ^ 



This table might be shown If the present work Is printed. For the 
moment, the reader can refer to many books, notably Fisher and Yates (1967) 



or Cochran and Cox (1957). 
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Appendix - Programs for electronic computers 

There follow two programs for the electronic computer. The first is for 

an experiment without conditioning Period, l.e., one where the first Period 

of experimental results is the first Period of Treatment. The second is 

for an experiment with a conditioning Period, l.e., one where the first 

Period of experlm ^al results is preceded by a Period to control the 

Change— over. Many people will never need the second program,. These 
prograjns malie an analysis , along the lines discussed In the present boolc , 

^Iven the Design and results for an experiment. It Is convenient, and 

in some cases vital, for the actual analyses dlBcussed in the text. It 

is written In FORTRAN U, as used by the stanu-apart , IBM 36 O -65 at 

EduGatlonal Testing Service in 1969. This pro^’am is accompanied by a 

(3.igcussion of the steps of its construction with the idea that it may 

be modified a little for other similar machines or for a shared-time 

system. The latter is, of course, much preferable for problems of the 

magnitude usual in experiments like those discussed In the present 

book. 

In these programs all Rows must be entire. Shortcomings in the Design, 
i.e., missing Rows do not affect the execution. The programs deal with 
pairs or a single Change— over up to Designs for latln aquares. The analysis 
Is made without allowance for Carry— over and if possible with that. In 
the more simple first alternative it is suitable for experiments that are 
not Change-over experiments. Various size limits to nimiber of Treatments, 
etc. are suggested in the programs. They depend upon the storage space in 
DIMENSION. If this is exceeded the machine will give unreasonable results 
and may stop. 
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TOien one looks a"b it closely one sees that it is concerned entirely 
■with the huslnesB of setting up the necessary least squares equations. 

This is the skeleton of the prohlem and once this la done out, we can hang 
all the organs about , like necessary conditions , residuals squares and 
prlnt-out . 

The program will accept and handle paired comparisons, l.e., those 
with hut a single Change— over . A reduced foria of this program suitahle 
only for paired Qomparisons , without conditioning might he written hy 
simply cutting down the present program. 

The detailed discussion of the program that follows is a reprint of 
program #1.2 of the Manual of Scientific Programs, Office of Computation 
Sciences, Educational Testing Service, Princeton, N.J. 

I. The class of designs covered is latin squares or fouden ree-cangles 
(incomplete latin squares). These may he repeated fully or In part. The 
desl^i may he defective, l,e,, certain whole rows may he missing, hut no 
allowance has heen made for missing cells, l.e., single ohservations , 

The purpose of this program is primarily to analyze the results for 
effect of Treatment with allowanee for C’arr^-over of preceding Treatment, 
mere is also direct testing of the el^lflcanee of Carry-over. TOiere is 



« 

By kind permission of the Director* Mr, Harry H, Harman, 
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included parallel estimation and testing of significance -without allowance 
for Carry-over. 

The program, as presently stored, allows analysis for designs up to 
40 Rows (or blocks). This is limited by the dimension of the data matrices. 
It could be readily enough changed to 500 or 1000, if such an experimerit 
were Involved. The analysis has been contrived so that such Increase 
does not Increase the size of the matrix involved in equation solving. 



II. GENERAL 

The basic equations are 



( 1 ) 



^ijk 



+ a. + Bj + + ®ijk 



where v is an observation assumed built of a general level y , 

ijk 

effect of the i^^ Row or individual a. , the J Period or Column 
6 , the Treatment and extraneous varlatilil ^ . This 

equation obtains for the first Columi or Period when there has been no 
conditioning Period. For the following Periods 



( 2 ) 



njM = M + 0 .^ + \ * ^ + qjM 



where the effect of the t*** Treatment in the preceiiinw Period is 6^ . 

For ^conditioned experiment Equ. (2) obtains in all Columns. 

The data actually considered ane the differences within Rows such as 



(3) 



y,. 



- y. I . I, I « I = 04 ■* I - Yv'i * ~o 

ijk£ -^i'J'k'a' J J' k k £ a 



5o. 



(j' # J , k' # k , £• # £) . 



These differences are then set forth in a matrix, 
latin squar-e for which the first line is 



O 
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Thus for an unconditioned 



Design (l) ( 2 ) ( 4 ) ( 3 ) 
ReSTilt 4 5 T 6 
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we may consider the two differences 



O 
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( 4 ) 



yiu ~ yi22i ® 6i - 62 Yi - Yz - + 6111 - em 

71221 - 71342 - 62 - 65 + Y2 “ Y4 + <51 - 62 + £1221 “61342 
which resiilts In two lines of the matrix as follows; 

8j 62 63 S4 Yl Y2 Ys Y 4 ^1 ®2 64 Result 



+1 -1 
+1 -1 



+1 -1 
+1 



-1 

-1 +1 -1 



Least sqLuares equations are In the same form. For instance, to get 
the equation associated with 82 each line Is multiplied by its content 
in the 82 column and the product accumulated over all columns. For each 
set of effeets (6 , y or 6) the last equation is replaced by a condition 
equation 



(5) 



£ B, = Z Y,, = D 6, 
J - k ^ t 



The analysis without Carry-over (sAWS DILTA) is gotten by replacing, 
temporarily, all equations appropriate to 5 by 



(6) 



6^ = 0 



The analysis without Treatment (SAHS OAMMA) is obtained by the temporary 

replacement 



(?) 



Yk ^ 0 



The residual verlabllity is gotten in several steps. First the 

variability residual on 6 , y and 6 is 
* 

IJk "ijM ■ J 'j'L * xL 

■ I * ijt ■ I ij\ 



5 b D 



Secondly* an estimate of t 
the mean of the values 



is made by finding from Equ. U) or (2) 



( 9 ) 






^ijk£. ^IJkt ''^k 



Thirdly* estimates of a. are made by finding the mean of the values 



^ijk " yljk ' ^ 



(10) 



y! •■uo " 



■'iJkJl -ijk£ 

Tlie residual variability as from equation (8) is then further and finally 
reduced by 



u 



r 

ljk£ 



^ijk£ 



+ E a. 
1 



E 

Jk£ 



^ljk£ • 



Residual variability on the effects of u , Rows and Colujms only 
(sans delta & SANS GAJ#W.) Is gotten by the formula fai^iliar^ in analyain 
variance. 

The test of significance for Treatments •without allowance for Carry- 
over is based on residual variability SANS DELTA leas residual variabilit.. 
SANS DELTA & SANS GAJ#1A. The test with allowance for Carry-over is from 
residual variability on FULL MATRIX less that on SANS GAM4A. The test for 
over is froni residual variabilitj'’ on FULL MATRIX less that on SANo 

DELTA. 
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It need onl^ be added that there Is incorporated a test on whether 
the situation is undsx -determined. The program counts the niuttber of 
different Row patterns, multiplies this number by the niimber of Coliamns and 
checks whether the result exceeds the number of independent parameters to 
be estimated. In the case of under-detai m lnatlon it refuses to analyze. 

A second type of refusal arises If the simultaneous equations prove insol- 
uble, which may arise if the design is redundant. Finally, if there is 
no residual freedom, the progpram will estimate the parameters but declare 
F ^ 0 . 

The scheme is disgramatically as follows: 
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Read and store 
Design and 
Data 



Count number 
dlatlnct Row 
patterns . 
StOTe 



Equations SANS 
DELTA . Solve and 
find residual 
variability • Store 



Reduce variabil- 
ity further by 
estimating mu 
and alphas 







Equations SANS 
GAMiSA. Solve and 
find residual var- 
Btore 






Check number dis- 
tinct Row Patterns. 
Solve PULL MATRIX 
and find residual 
variahility. Store. 



s 


^ 


Find resi( 
ability Sj 
& QAmk b; 
of varlani 


iual yarl- 
MJS DELTA 
y analysis 
ee. Store 



Find F value for Treatments above from 
SANS DELTA & GAJOIA with SANS DELTA. For 
Treatments with Carry-over from SANS GAM4A 
and FULL MA’nilX. For Carries-over from 
BANS DELTA and PULL MATOIX. 



O 
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Build Up least 
squares equa- 
tions using 
differences 
one Row at a 
time 

— m " 



- - ^ 

Get horizo 
difference 
factor mat 
one Row at 


^ 2— 

ntad. 

8 In 
rix 
a time 


^ 


k U 



Replace last Equ. 
of each set by 
zero condition. 
Store as full 
matrix 



Subroutine to 
solve eqtiatlcMis 




Q 
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III. INPUT 

The progrwn starts with a par-aiiieter card which indicates the numbers 
of Treatments 5 of Col\ainns in the pattern of Treatments, of Columns of 
Result and of Rows of Treatment and Result (FORMAT (Ul5)). The second 
number will be one greater than the third in an experiment with a condition 
ing Period but the SMie in an uncond, .ioned experiment. 

Then ^-^llows a card for each Row of Design (FORMAT { 613 )) ■, i.e., 
statement of Treatments and, finally, a card for each Row of Result (FOPMAZ: 
( 6F5 . 0 ) ) . 

IV. PROGRAM 

Because there are two experimental designs for change-over experiments 
two programs have been written. The first, ZFE-03, analyzes the resul^s 
from a design that did not include a conditioning week. The second, ZPE-Ol 
analyzes the results from a design that did Include a conditioning week. 

In each case the parameter card will give the number of treatments, the 
number of columns of result, the number of coliimns of patterns and the 
number of rows . . In the unconditioned experiment the number of columns of 
results will eq.ual the number of columns of patterns. In the conditioned 
experiment , the number of columns of pattern will be one grea’ter than the 
nijmber of columns of results . 
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V. OUTPUT 

The Design and Results are printed out. The least squares estiaiates 
for Columns and Treatments are printed (SANS DEDTA) as they are found 
without consideration of Carry-over. Then the estimates for ColumnH , 
Treatments and Carries-over are shoim (FULL MATRIX). Finally the analyses 
for significance are printed. There Is a test for Treatment, without 
allowance for Carry-over, a test for -n-eatment , with allowance, and a teat 
for Carry-over. In each case there is shown the variance ratio, F . with 
its two statements of freedom. 



VI. ILLUSTRATIVE EXAfffLE 

By aray of illustration there follows the case of a double Youden 
rectangle for 7 Treatments and lU Rows. Six Rows of ’■he Design 'fer® 
repeated but in Me end 2 men were lost so •hat •hfre were l8 Partlcip«Qts 
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PARAMETER CARD 



7 4 

PATTERNS 

1 2 


4 

4 


18 

7 


RESULTS 

55,00 


37,00 


47,00 


45.00 


2 


3 


5 


1 


37,00 


25.00 


25.00 


38,00 


4 


5 


7 


3 


24.00 


24.00 


29.00 


46.00 


5 


6 


1 


4 


36,00 


44.00 


39.00 


52.00 


6 


7 


2 


5 


42.00 


54.00 


50,00 


55.00 


7 


1 


3 


6 


49.00 


37.00 


56,00 


62,00 


i 


5 


3 


2 


42.00 


45.00 


35.00 


32.00 


2 


6 


4 


3 


55 ,00 


60,00 


52.00 


60.00 


3 


7 


5 


4 


54.00 


60,00 


57.00 


54.00 


4 


1 


6 


5 


42.00 


44.00 


46.00 


44,00 


5 


2 


7 


6 


46.00 


48.00 


54.00 


47.00 


6 


3 


1 


7 


42.00 


54.00 


42.00 


42,00 


7 


4 


2 


1 


49.00 


42.00 


47.00 


48.00 


1 


2 


4 


7 


34.00 


43.00 


46.00 


54.00 


2 


3 


5 


1 


52.00 


55.00 


42. 00 


42.00 


3 


4 


6 


2 


38.00 


38.00 


26.00 


2 8.00 


4 


5 


7 


3 


50.00 


62,00 


50.00 


61.00 


6 


7 


2 


5 


42.00 


49.00 


51.00 


6 3.00 



ESTIMATES OF VARIARLFS 



SANS DELTA FLJLL MATRIX 



BETA 

-1 *3B5 R 
-0.1037 
-1 . 3409 
?. 8304 

GAMMA 

-1 , 9907 
-1. 1776 
4.1289 
-0,6008 
0. 1367 

-1.2^1 1 _ 

0. 7846 

DELTA 

“ 0,0 
- 0.0 
- 0 . 0 

- 0.0 — 
- 0.0 
- 0.0 

0.0 ~ 



-1 . 374? 
-0.1668 
-I . 3384 
2.8795 

-1.4136 
- 0.527 9 
3 .8 279 
-0.9817 
-0,6040 
-1.4894 
I . 1887 



0.7361 
2.8368 
0 . 7053 
-0.1414 
-2.0391 
- 1.4626 
-0.6351 




€ 
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ANALYSIS 



FACTORS I O.F. | RFSIDUAL VAR 

MU ROWS COLUMNS CONTROV I 51 , I 218R.37 

CONTROL FACTORS PLUS TREATMENTS | 45, I 1975,20 



6. » 45 , 



?lBfl.33 » 19 73^20 ) 

1973,20 / 45. 



OiB2 



FACTORS I O.F. | RESIDUAL V^R. 

MU ROWS COLUMNS CARRIES-OVER CONTROL I 45 . I 2045,45 

control FACTORS PLUS TRFATMFNTS | 39. j 1R74.19 



F ^ f 2045^65 - I874.L9 1 / 6 ^, - 0.59 

6. »39, laTV. 19 / 39. 



FACTORS I O.F. I RFSIOUAL VAR. 

MU ROWS COLUMNS TREATMENTS CONTROL I 45. \ 1973.2^ 

CONTROL FACTORS PLUS CARRIFS-OVFR I 39, | IR74.19 



F ^ L ^ 0.34 

6 , f 3 9 . 18 74, I 9 / 3 9 , 
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There follows the program for an e3q)erlment without conditioning 
Periods i.e.s one where the first Period of experimental results is the 
first Period of Treatment. There Is presumed to he common Carry-over on 
this Period. 



O 

ERIC 
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DIMENSION 
DIMENSION 
DIMENSION 
DIMENS ION 
Dli-i ENSIDN 
DIMENS ION 
DIMENSION 

1LBW( 3) 

REAL=i'4 KRPC(40,8) ,|vUJ 
HEAL ^'8 i-iIDO) 

DATA DED/ ' 

1 I 



W(8t49) ,WD(28t49)tWV('49) 

SC(B),SR(40) ,RS(4) 

KPP(4U»8) ,Q (49y49JxV I_49) s«V(3,49) 

A{40) ,8(2U) ,D(2Q) »G(2U) 

HED(3 ,3 ) 

U.ED(6,4) ^JSW(3J ' 

RESHED(9t2 ) ,RESSUb (3,3 ), Lu’( 3, 2) ,DF ( 3) , LK ( 3, k ) , LTw'( 3)V 



LWWj49i49L 



I 



D E T E R M I M A N J _ 0_V fc R F L 0 W 



I 



1 



DATA 

data 

DATA 

DATA 



HED/* SANS 
HESSUB/ ' 



matrix 1/ 



' / 



DATA 



:c 

:c 

;c 

:c 

;c 

;c 

;c 

;c 

• G 

;c 
c 
■ C 
c 
c 
c 
c 



DETERMINANT UNDERFLOW ■, 

MATRIX WAS SINGULAR '/ 

DELTA ',»SANS GaMm A J,'FULL 

" '^V' THE ATM ENTS''" , ' GaKK l ES-f)VER • 

LD /I ,2,2,2,3,3/ ,LK/4,2,L,1 ,3, 3/,LTW/l ,3,k/,LbW/k,k 

RESHED/ 'MU HOWS COL UMNS CUimTkOL', 

•CONTROL FACTORS PluS " 

MID/ ' beta ' , 'GAMMA ' , 'DELTA' / 

KCTT = COLUMN + TREATFiEllT + CaRRY-UVER 

KCTl = KCTT + 1 

KPP ( ROWS, COLUMNS ) PaTTEkim MATRIX 

KRPC (HOWS, COLUMNS) JKESULTS MATRIX 

W (COLUMNS , KCTl ) W IN(iERSKY MATRiX 

WD ( (KC*(KC-1 )/2 ) ,KCT1 ) DIFFERENCE 
WV (KCTl) . WljNGERSKX^U^XTOR 

0 (KCTl, KCTl) work' Matrix” 

V (KCTl) WORK VECTUR 
RV (3, KCTl) ESTIMA TES VECTORS 
A (ROW) ROW COUMTS 



/ 

,3/ 



i A IRIX 



101 

901 



B 
D 
G 

WW 
D 

NPAGE^l 
WKITE( 6,901 ) 



(COLUMNS) 
(TREATMENTS ) 
(CARHY OVER) 
(KCTl , KCTl ) 
(TEATMENTS ) 



column counts 

TREATMENT COUNTS 
COUNTS 



carry over 

WORK MATRIX 
TREATMENT COUNTS 



NPAGE 



F 0 R M A T ( ' 1 • , / / / , ' ANALYSIS 0 F_ ^R R Y OVER' , T 1 2 7 ,13 , 



) 



2 

3 

16 



lu 



1/,' GEOFFERY BEALL, 
NPAa£=NPAGE+l 
FORMAT ( 1 1 ) 

KIN- 5 

WRITE! 6, 12) 

FORMAT! IX, •PARAMETER CARD' ) 
FORMAT! 1015 ) 

FORMAT! 10F5.1) 

FORMAT! ' + ' ,60X,1UF7.2) 
READ!KIN,1 )KT,KC,KRC,KP 
FORMAT! 5 IS) 

WkITE!6,17) KT,KC,KRC,KP 
FORiMAT! 1X,SI5) 

DO 116 1=1,49 
DO 116 J=l,49 
00 116 K=l,3 
KV! I ,K)=0. 

It J)=0 

1 = 1,8 

0 



I ERIC 117 

|Llap™! I) = 
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CAKOOOl'Oi 
CAkOOOkO 
,CAR0U0 3U^ 
CARGO!) 40^ 
CAROOOSi;'! 
..OARijUOhuJ 
CAR0UO7U:; 
CaROO!)«U i 
CAR0U09 0^ 
'CAROOlob , 
CAKUOllOi 
CAR!)01201 
Cak6oi30? 
CAR0014D; 
.t'AROOiso ; 
CaR00T60 
CAR00170 
CAI^OlfciU ^ 
CARooiDb ; 



CAR00200 



1 



CAROUklU I 
CAKOO220I 
CAK0023U ’ 
CAkOU24U 
CAKOUkbO 
CAKD026U 
CAR()02 70 
CAR002B0 
CAI<f.)U29U 
CaKu030u 
CAR 0031U 
CARU0320 
CAR0U33U 
CAKU034U 
CAH0035U 
CAK003fo0 
GAk 0037U 
CARGO 3 bU 
CAR00390 
CAR00400' 
CAR00410 
Cargo 42 (,N 
CAK00430i 



DO .115 1 = 1,40 

A( n=o 

115 Skc I )=0 

KCTT=KC+2»1M<T 

KCT1=KCTT+1 
l.)P = U 

00 105 I = 1,KP ’ 

KEAD( KIi\l,2 ) (KPP { I , J ) , J = 1 ,KC} 
IF(KC.GT,5) GO TO 105 
IF( I ,tO,l ) GO TO 10 5 
IK= I-l 



DO 104 K=1,IK 

DO 103 J=1,KC 

IFCKPPC I ,J) .NE,KPP(K,J} ) GO TO 104 

103 COiMTiNUe 

DP=DP+1 ■■ ■ 

GO Tu KJ5 

104 CUNTIivUt 

10 5 CONTINUE 

IPC = KP-t)P 
WKITE(6,13} 

1 3 FORi iATC ' PATT EPNS ' 52X , * R bSULfS‘'T"‘ 
00 111 1=1, KP 

tUrAD( KIN,3 ) (KKPC ( I , J 1 , J = 1 , KC 

1,U) 110 J=1,KC " ■■■ 

SH( I ) =SK ( I ) +KKPC ( I , J ) 
llU SC( J ) = SC ( J ) +KKPC ( I , J) 

WRIT E( 6 ,2 j ( KPP ( I'VJ ) , J = 17kC r “ 

111 WHITE(6,16) (KKPCdtJ) ,J = 1,KC) 

DO iy« 1=1,49 
193 WV( I )=0 . 



00 199 1=1,20 
b( I )=0 
D( I )=0 
199 G( I }=0 



C=0 

TSA=0 

T.SSA=0 

DO .135 K=1,KP 
; DO 122 J=1 ,49 

! DU 121 1=1,8 

II 2 1 W ( I, J ) = 0 

t DO 122 1=1,28 

|122 WD( I , J) =0 
; DO 125 I=1,KC 

I W( I,I)=1. 

!••( I-,KPP (K, I )+KC) =1, 
IFU.EO.l) GO TO 125 
W < I , KPP ( K , 1^1 ) +KC'+KTT=1 . 
125 W( I ,KCT1 ) = KRPC (K, I ) 

KCPll = KC-l 

Nl=l 

i LA=0 

^ DU 130 I=l,KGHl 

1 = I'! 1 + 1 

i DO 130 J=N1»KC 

I LA=LA+1 

I DO 130 L=lfKCTl 

0 Wl) t i A , L } = W ( I , L ) - W ( J , L ) 

ERJC DU 134 1 = 1, LA 

MMfeiiffjjffTifad "k.; 




00 i34 J = 1,KCTT 

00 134 L=1,KCT1 

134 WW( J ,L ) =WW ( J ,L )+WD ( I , J )4WD { I ♦ U 

135 COWT INUe 

0 COiMDIT ION IhiG DIFFtRECCE MATRIX 
00 140 I=1,KCT1 

WW(KC?n=0 

WW( KC+KT, I )=0 
140 WW(KCTT,I)=o 

Nl = l 

DO 15u IsKCtKCTTjKT 
□0 149 J=NltI 

149 WW< I ,J ) = 1. - 

L50 N1=I+1 

N=KC+KT+1 

DO 175 1=1,49 ^ ■ - 

DO 175 J=l,49 
175 0( I , J)=0 

DO 190 K=lt3 

I F ( ( K , EW. 3 ) * And , ( ( I PC -!=KC ) * LT • ( KC+2WKT-1 ) ) ) GO TO ZoU 
DO 185 I=1,KCTT 
DO 185 J=1 ,KCT1 
185 0( I j J )=WW ( I , J ) 

IF(K.EU.3) GO TO 181 
r‘i = l\H-KT~l 



DO 180 I = 

DO 180 J=1,KCT1 

.80 y( I , I )=i. 

N=N-KT 

.81 DO 192 I=1,KCTT 
.92 V( I )=0( I ,KCT1 ) 

CALL Lli\lEQ(KCTT TQ»Vfl jDET ji-IORT ♦49) 
.89 JSW(K)=M0RT+1 
; IF(KiORT,NE.O) go to 186 
DO 188 I=1»KCTT 
.88 RV(l<,n=V(I) 



; GO TO 190 

;'.61 FURMAT(//,» INADEQUATE FOR CARRY OVER') 
;'6o i'iRrrE(6,26i ) ^ 



I JSH(3)=4 
} B6 DO 187 I=lfKCTT 
I 87 RV(K,I )-0 
!' CONTI (MU E 



I URITE(6,902) NPaGE 

|02 FORl'iATl • 1 '♦///♦ ' ESTIPiATES OF VaRI A 8LES ' ♦ T1 27 » I 3 ) 
* IMPAGE=NPAGE+1 



f Nl“l 
I N2=KC 




WRITE! 6t203) ( (HED( I ♦ J ) , 1=1 ,3 ) 
F0R|viAT(///j2(28X,3A4) ,//) 



J=it3f2) 



DO 209 1=1 f3 



WRITE! 6t205) HIU(I) 



05 FORMAT! 52 X tAB ) 

DO 206 J=NlfN2 

06 WRITE!6,204)RV(1,J) ,RV(3,J) 
04 F0KimAT! 2 (28XtF12,4) ) 



;o 



“■^=N2+1 

ERiC''^24KT 
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CARO 1040 ; 

Caro 10 50 ' 
..CARO 10 60 ; 
CAR01070 ^ 
CavkOIukO ; 
CARO 10 90 i 
CAROllOO i 
CAROlllO { 
CAR01120 ; 
CAR01130 i 
CAR01140 i 
Caro 11 50 i 
CARO 11 60 ; 
CARO 11 70 j 
CARO 11 80 ■ 
CAK01190 - 
CARO 1200 ; 
Caro 12 10 i 
car’d 1220 i 

CAR01230 : 
CAR0124U 1 
CAK01250 j 
LA KOI 2 60 i 
CAK01270 I 
CAR012B0 ' 
CAH01290 j 
CARO 1300 j 
CAR0131U 1 
CARO 1320 ' 
CAH01330 i 
CAR01340 1 
CARD1350 i 
CAR0136() j 
CAR01370 : 
CARO 1380 ' 
CAR01390 ^ 
CAR014D0 < 
CAR01410 ; 
CAR01420 j 
Caro 1430 ,| 
CARO 1440 I 
Caro 14 50 | 
CARO 1460 I 
CAK01470 I 
CAR014BU 
Caro 1490 
CARO 1500 
CARO 1510 
CARO 1520 
CAR01530 
CAR01540 
Caro 1550 
CAR01560 
CARO 1570 
CARO 1580 
CARO 1590 
CARO 1600 
CAR0161C 
CARO 1620 
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WK I T t { 6 , 2tj 7 ) ( ( D ED ( L » J SW ( K ) ) t L = 1 j 6 ) , "k= 1 f 3 , 2 ) 

207 FUKimAT ( 1 ax ♦6A4, 14X t6A4 ) 

QO 200 1 = 1 , KP 

DO 200 J=1,KC 

IF( KPP( I , J ) , EQ.O ) GO TO 200 
WV( J)=WV ( J)+KRPC ( I , J) 

WV ( KPP ( I , J ) +KC ) =WV ( K PP ( I , J ) +KC ) +KRP G ( iTj')” 

IF(J.EQ.l) GO TO 201 

WV< KPP( I » J-1 )+KC+KT) =WV (KPP ( I , J-1)+KG+KT) +KKPG( T .,1 ) 

201 TSA=TSA+KRPC (1,0) ^ ^ 

TSSA=TSSA+ ( KKPC ( I ? J ) ( I , J ) ) 

C=C+ 1 • 

A(i)=A(n+i. — — 

B( J)=B( J )+l, 

G(l<PPCI,J)) = G(KPP(I,J))+l. 

I F ( J . E 0 . 1 ) GO T 0 2 0 Ci 

tHKPPC 1,0-1) )=D(KPP(I,0-1) )+l, 

200 CONTINUE 

uo 300 kbi ,3 — : - 

I F ( OS W ( K ) . N E, 1 ) GO TO 3 00 
TSSbTSSA 

TS = TSa - 

00 210 I=1,KCTT 

210 TSSsTSS- (RV (K , I )4wV ( I ) ) 



DO 220 1=1, KT 

220 r'iU = G( I)>;'KV(K, I + KO+DII ) -KV (K , KC+KT+ I )+NU 

i"lLJ= ( TS-MU ) /C 

TS5=TSS-NU*TS 
DO 230 1=1,KP 

SA=0 ' ^ 

SB=0 

DO 230 0=1 , KC 

SH=Sti+l<HPC ( I ,0) ■ 

IF(J,E0,1) GO TO 225 

GC~T0*^2 3(3 ^ I ^ KC+KT+KPP ( I , 0-1 ) ) -IiU+Sa 

225 Sa=KRPC ( I ,0 )-RV ( K , (KC+KPP ( I , J) ) ) -PiU+SA 
230 COaiINUE 

SA=( SA/A ( I ) )^'SB 
'25U TSS=TSS“SA 



■ RSCK)=TSS 

; 300 CONTINUE 

I FKP=FL0AT(KP) 

! FKC= float ( KC ) 

I FKT= FLOAT (KT) 

I S3C=0 

I 00 310 I=1,KC 

I 310 S S C = S S C + S C ( I ) '!' ’i' 2 7 F K P 
} SSK=U 



I DO 320 1=1, KP 

j, 320 SSK«SSk+SK ( I ) *:«42V FKC ' ' " " 

I HS ( 4 J =TSSA+ ( ( T SA-rTSA ) /C ) -SSC-SSk 

DF( 1 ) =C-FKP-FKC + ] . 

i DF(2)=C-FKP-FKC-FKT+2. 

DF( 3)=C-FKP-FI<C-2.*l«FKT+3. 



I 903 

‘ O 

ERLC 



WkrrE(6,903) npage 

FOkHAT( '1 *,///, • ANALYSTTIDI^TkI ANCe^ , Ti2 7, 13) 

NPAGE=NPAGE+l 

DO 400 K=l,3 




Cai<oh 

CAkOlfi 
CAROie 
CAkOlf 
CmROIE 
CAK01(: 
CARO 16 
CAR017 
CAROIJ 
C A kO'i 7 
CARO 17 
CARO IT 
~ C A ROTT 
CAR017 
C_AR017 
"CaF:oT7 
CARO I 7 
CA^iOO 1 0 
CAROia 
Caro 18 
caroih: 

’ CARD la,- 
Caro iH! 
CAROl He 
Card i a ' 
CAROl 8 
CARO 1 8 • 
C'aRO 1 yi 
Cako 1 V 
CAROl 9: 
Caro 19 
CARO 19 
CAR019 
CARO 19 
Cako 1 9 ; 
CAROl y: 
CAROiyi 



.CARU2 0, 

CAHO 21.4 

Cako 2(J e 
CAK020 } 
CAhCi2l,i j 
CaR02o ; 
LAR020^ 



CAK02(h; 
Ca R O •' 0 5 
CAKOpi.; 
Ca K(J 2 L| 



CAR 02 i| 
CARO 21 I 
Caro 21 1 
'C‘Ai-V02l| 
CAKU2ii 
CAK02E- 
’CARO 21 I 



CARO 212 
CAR02l| 
CARO 2 28 
CAKO 22 I 

CAR02i^ 
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I F ( J S W ( K ) . i\l E . U GO'”t' o"' 3 90 ‘ ‘ C A RO 2';;^ 30 i 

WKITE( 6,331) CAR0224U 

331 FORKiaTC ///, 19X, 'FACT ORS* ,1BX , ' I P.F. I' .' RESID_UAL VARIABILITY') CAR 02260 j 

WKITE< 6,332) • CAK02260 i 

332 FORmAT(' — — — — — ^ -CAK02270 ; 

I CARU22BO j 

DO 335 J=l,3 ' ■ ■ ' ‘CARO‘22 90 ; 

ReSHED(4+J,l)"RESSUB(J,LTW(K) ) CAkU2300 i 

33 5 KESHED(6+J,2)-R ESSUB(J,LBW(K) ) CAK0 231U ? 

00 338 J=l,2 CaR0232U ' 

338 WRITE(6,333) ( RESHED ( I , J ) , I = 1 , 9 ) , UF ( LD ( K ) ) ,KS(LK(K,J) ) CAk02330 1 

j33 F0RI'''iAT{4X,9A4,4X, ' I ' ,F4«Q, ' | ' ,2X,F iO »2) _ _ CaR0234(> s 

WRITE(6,332) ^ ~TM02350 T 

DFF = DF(LD(K,1) )-DF ( LD I K , 2 ) ) CAR02360 I 

RE=( <kS(LR(K,l ) )-KS(L R(K,2) ) ) » PF ( LD ( K, 2 ) ) ) / ( RS ( LR ( K, 2 ) )^:0)FF) CAR02370 

WRITE(6,336) RS ( LR '( K , 1 ) ) , RS ( LIU K , 2) nW ' CA¥u2 3B0 ? 

336 FORMAT( //,18X, * ( ' ,F10.2, ' - ■,FB.2,' ) / ' , F3 . U , 6X , F5 . 2 ) CAR02390 i 

WRITE(6,334) _ _ CAJ<024UU < 

334 FORMAT ( ' + ' , 7X , ' F ' , 7X , ' = ' ) ‘ CAR0241 0 1 

WRITE( 6,337) DFF , DF ( LD ( K , 2 ) ) , RS ( LR ( K, 2 ) ) , DF ( LDIi<, 2 ) ) CAR02420 ! 

337 FORMATC 9X , F3 .0 , ' , ' , F3 . 0 , 8X,F8 .2,' / ' , F3.0) CAR0243(J ] 

IF( JSW(3).iME.l) GO TO 501 CAR02440 j 

GO TO 400 CAR0245U ? 

390 WRITE(6,391) (DED(L,JSW(K) ) ,L=1,6) CAR02'+6u l 

391 F0RMAT(//,1X,6A4,//) ' CAR6247t) I 

400 CONTINUE CAR024B0 1 

501 READ(5,26) IT CAR02491M 

IF(n . eo.l) GO TO 101 CAR02 500 * 

FORHAT( IX, 17F4.1 ) • CAH02510 ^ 

FUKMAT( 1X,9F8 ,3 )_ , . , UaM2J2U | 

FO RM A T { 1 X , F 1 2 • 4 ) CAR02530 | 

CALL EXIT CAR02540 i 

End CARa2 55u I 

I 



i 




2u 



60 

du 

85 



luu 

lu5 



13u 

140 



?MU 

?.10 



2 50 
2oU 



s 3 b iJ 



i 3 b (i 



I 3 6 U 
I 37U 
I 3bCi 



43 U 

46u 

SOU 

350 



C 



D mi" ^ / Mr ^ V ’ ^ . U tl-; T iURT; RR j 

■BaiiiO.LeNct n'jow!jRuw^rO^ 

l'•lURT=u H -. i ..M s^.kQLtJuU L ) , ( 

1 1^10= 2 
iJE’l' = 1,0 

OU 2v J=ijivl ’" ■-. 

IP I\/( J) =0 
□ 0 5 50 I = 1,|\| 

Ai4AX=0.0 - 

. DO 105 J=i ,|v! 

II-(_IRIV(J)-1)6o,1o5,60 

DO iOO K=ij|\j " ' ... , 

IF C I F IV (K )-i j 8 q ^ j^Qy ^ Y20 

I R 0 W= J ^ ^ ~ ^ ^ ‘ Lila 5 j U)Oi 1 00 

ICOL=K 

AOaX=a(J,K) 

COr'JTIi\=UE ^ — . 

CUNTIisjUE 

IFIV( ICOL) = IPIV( ICCJL)+1 

IFUPIV(lCDL)-.l)720,i30,72u 

iFUkUl7 ^CDL)14 o, 260,14U 
DtT=-DEl 

. DO 200 L=1 ,N ■ • 

SWAP=A( IROI.J , L ) 

A ( I HOW , L ) =A ( I COL f L ) 

A ( I C(jL j L ) = SH A H ' - 

IF(H)260,260j210 

DO 2 50 L=l,f.j 

SWaP = B( IROw,L) 0 " 

li( IROW,U = B( ICOL,L) 

DC ICOL ,L )=SWAP 

IlMO tX (I , 1 } = I KQuj ■= - - _ __ 

INUFX< I ,2) = IC0L 
PIVOT( I ) =A ( ICOL » ICOL ) 

lHAitS(PIV0T(I)l.LT..0001 )GC) 'TO Mio 

Dbr=ijtT-;'PivoT (I ) 

I F ( ABS C D ET ) -1 , E36 ) 325 , 71 2 .,7 1? 

ikVMD5(Ubl )-i.t-35)7i;3^7]_3 

A( ICOL » ICOL ) = 1 .0 
DO 3 50 l=:l,i\i 

A( ICOL , L )=A ( ICOL »L )/PIV0Y(T) 

IF (m) 380, 380 ,360 

00 3 70 ,L=1,0 

B( ICUL,L) = B( IC0L,L)/P1V0T(I r 

DO 550 L1=1,N ^ 

I F C L 1 — I COL ) 400 , 5 50 , 400 
r=A( Li ,ICUL) 

A(L1, IC0L)=0„0 
DO 450 L = l,i\j 

A< LI ,L )=A( LI ?L )-A ( ICOL ,L )»rr 

1 F(;'i) 550 ,550,460 
DO 500 L=l,|.| 

B(L1,L)=B(L1,L)-B(IC0LVl)«7 

CONTINUE 
DO 710 I = l,,vi 

L=iM+l-I ... 

I F( IkoEX ( L, 1 )-In0EX (L,2 )) 630,710, 630 



O 



378 



30 JkUi!=Ii\iOEX{L,l) 
JCUL=Ii\IUeX(Lfi') 

DO 705 K=1,N 
SWAH=A<K,JHOW) 
A(K,JKOW)=A(KtJCOL) 
A(l<*JCOL )^SWAP 
05 COMTIMUE 
lU CONTINUE 
KETUKN 
712 i»lORT=l 
KETUHM 
715 N0RT=2 
RETURN 
720 M0RT=3 
RETURN 
END 



DUO 3360 ' 
0003370 i 
000 3_3BO ; 
'000 3 3 “^/O ? 
(j00340U 
0003A-1O I 
00034201 
000343U 1 
00034401 
0(.)0345U| 
000346(^1 
000 3 4 70 I 
00034H0 I 

0U0349(J I 

0003500 3 
fi003510 i 



1 




There follo'ws the program for an experiment with a conditioning Period, 
i.e., one where the first Period of experimental results is preceded by one 
to control the Change-o-ver . This program uses the same SUBROUTINE LINEQ 
as the preceding, but it is not shown again. 





38o 



C 

c 

c 

c 

c 

c 

c 

c 

c 

c 



tHHI-IMS lUN W (8 »53 ) »WDi^8f 53) fWV(53) 

DliMENSIOiM SC(a ) f SR(40) ,RS( 

I.) I I'l EN S 1 0 i\i K R P (j40 ♦8ltU(53«53)»V(53)»RV(3tS3)> KPC( 4Ut .91. 

L) I M El\lS I UN A { 40 ) ,B(20),D(2U)tG(2u) 

U lUN H ED (3,3) 

i) '( c, EN S I UN D ED ( 6,4) , J S D ( 3 ) 

Din EMS ION R ES hED ( 9,2 ) , RESSUB ( 3 , 3 ) , LD ( 3 , 2 ) , UF ( 3 ) , LR ( 3 , 2 ) , LTW ( 3 ) , 
ILhWC 3 ) 

K EaL’:-4 KRPC ( 40 , 8 ) , NU , WW (53,53) 

KHaL-I'-U i-iID(3) 

EUU I Va L ENC E ( KPC ( 1 , 2 ) , KPP ( 1 , 1 ) ) 



00000 lU 
0000020 
JlQSlOlllii! 

00000 41 • 
00(Jun'>i' 
U(A)uo6i 



OOOOOYu 
UOOOiOm. 
00000 VO- 



I )A I A 

DATA 



1 

2 

3 



' i I U/ ' ii' ET /\_ 
DEO/ • 

I 

I 



' (jAl-ll'-i A 



' , ' DELTA 



/ 



I ) /\ T / \ 
OA T A 
IjmTA 
data 



D ET ERI'-i I LI Aim I 
UEjj^J;UnJi\iAlMT 
'nAtAlX 
delta 



UV ERF LOW 
UNUEKF LOlrE 



SINOLILaK 
' , ' S AIMS (.V Ai'il'i A 



' t 

* t 

• i 



U t / 1 ' ' ) ,M ' 
ODD-.; ,1. Ij 
' AH,d:i.2 ' 
ODD') I. 3' : 
Ui.T;'/ .1. A' 
OODn I. 5‘ i 



•FULL 



K 1 ) 



I , •TkEaThENTS 



Carr I Eb' 



•ovi-; 



ViEi.i/ • SaNS 

KEbSOii/' _ . i 

LD /I , 2 ,2 ,2 ,373/ ,LK/4,2, 1, 1,3,3/, LTW/1, 3,2/, LbW/2, 

RESHED/ 'NU RUlvS COLUNimS CONTROL', 

•i'.ONTROL FACTORS PLUS '/ ^ 



'X 

2,3/ 



i;i A '1.- 1 (•;' . .1 
U(.M," i ' i 
Oi.iL'0 1 'jU i 



KT = NO. OF 

K C = iM 0 • OF 

KCP” = NOV OF COLUMNS 
KP= NO. OF ROWS 



TREaTM ENTS 
CULUi'iS OF RESULTS 



IN PmTTEKIM 



KCTT = 
KCTl = 
KPP 
KPC 



KC + 

= KCTT 
(KP,KC ) 
(KCP ,KC ) 



+ K T 



PmTT ERNS 



aTKIX 

r-lATRIX W fllT CONOrri UNiNO WEEK 



KRPC (KP,KC) 

W (KC,KCT1) 

W D { ( K C K C- 1 ) / 2 ) , K C T 1 ) 
WV (KCTl) WINGERSKY 



^ p’att ERNS 
RESULTS MATRIX 
WINGERSKY MATRIX 

UIFFEREnCE MATRiX 
aTkIX 



Q (KCTl, KCTl) 



WORK i'lATRI 





V (KCTl) 
SC (KC) 
SR (KP) 


'work vector 

SUM UF CULUmMS 
SUM OF ROWS 




' ^ 


A 


( K P ) 


iioW"' cuu7ts 




i ‘ *» 


b 


(KC) 


COLUi’ii'i COUNTS 






D 


( K T ) 


TPi EATLi E nT COUNTS 






G 


(KT) 


CARR Y 0 V ik C OU IM T S 




7-'-' 


RV 


(3, KCTl) STORES ESTIMATES 




i: 


w w 


(KCTl , 


KCTl) WORK MATRIX 




7 


I'i A G 1 









iLUl 

(101 



2 



WRITE(6,y01) nPaGE 

FORi'iAK ' 1 ',///, ’ analysis OF CAKRY-QVE R WITH CUN 01 'I ION 
113,/, • GEOFF ERY BE A L H ‘,‘7"/ ■) ' 

NPAGE-NPAGE+1 

FOkMAT(Il) 

KIN=5 

W K 1 T E ( 6 , 1 2 ) 

FUKMAK IX, ‘PARAMETER CARD') 

FORMAT ( 1015 ) 

FORMAK 10F5.1 ) 



W E E K ' , T 1 2 { 1 



16 



FORMaK ' + ' ,60X,10F_67J L 
R EA IH K I N , 1 ) KT , Kr,KC P TK P" 
^ (RmAT(5I5) 

.ITE(6,17) KT,KC>KCP,KP 



0000190 I 
0000200 1 
00 002 10 i 

X 06 c) 22 iy I 

OO0U2 3O \ 
00 002 40 ) 
‘(JOCK) 2 50 'I 
0000260 : 
_OU0y2J/O I 

'UU002SMU I 

0UU02 9U 3 
0U0U 30U I 

“uooc) 3lu' I 

0000320 1 
00003 30 j 
'000(‘)340 1 
0O0U35U I 

I 

0000 370 I 

0UUU3oU 
0000390 I 
U0C)Q4Uu 
U00041U 
_UOOO_42u 
‘0000430 
0000440 I 
0000450 I 
000046U I 
000U47O 
0^00480 
'■000U49U I 
OU005UU 
0000510 

uooirsAuf 

00UO53O!' 

000 0540 

0(J00550;| 

UU0U560 

jjoooxiXj 

UOOOSVUg 

OOOU 6 UOI 



r 



7 



381 



.1 U >3 



104 

lUi 



104 



FUKi'IAK IX, 5 I 5')“" 

00 116 1=1,53 
00 116 J=l,53 
00 116 K=l,3 
RV( I ,KJ=U. 

116 WW( I , J)=0 

DO 117 1 = 1,8 

117 SCU )=0 

DO 115 1=1,40 
A( I ) = 0 ■ ■ 

115 SRC n=o 

KCTT=KC+2>:^KT 
KCT1=KCTT+1 
DP = 0 

00 105 1=1, KP 

READC KIN , 2 j ( KPC ( I , J ) , J = 1 , KCF) 

I F( KCP .OT. 5 ) GO TO 105 
IF( I .EQ.l ) GO TO 105 
IK= 1-1 

DO 104 K=1,II< 

DO 103 J=1,KCP _ 

IFCKPCC I » J ) .NE ,KPC (K , j| ) GO~TO 
CONTINUE 
0P=DP+1 

GO TO 105 

CONTINUE 
COnT INUE 

IPC = KP-DP 

i-J pa T E ( 6 , 1 3 ) 

FOkOATC ' PATTERNS' 

00 111 I=1,KP 
ReAr)(KIN,3) (KRPCd 
DO 110 J=1,KC 

SRC I )=SR ( I )+KRPC ( I , J ) 

see J )=SC ( J ) +KRPC ( I , J ) 
vlRITE{6,2)(KPCnTJ),J = l,KCP) 

WRITE(6, 16) (KRPC ( I ,J) , J = 1,KC) 
NRIT6(6,14) !PC 

FORFiATC//,' NUMBER OF UNIQUE PATTERNS 

DO 108 1=1,53 “ ^ 

WVC I ) =0 
DO 199 1=1,20 

i3 C I ) = 0 ~ ~ ■ 

DC I)=0 
GC I )=0 

C=0 ^ — 

■ TSm=0 
TSSA=0 
DO 135 
DO 122 
DO 121 
121 W(..I,J) 



00006U 
U00062C 
0OQO63C 
006064Ci 
00 00 6 5 C; 
000066C 



0000671 

000068C 

00Q_069( : 

000670 c 

0000 7 1C 
000 072 C 
0000 7 3C 
0000741! 
000075C 



0000 76C 
0000 77(1 
U0007BC 



, 5 2 X, 'R ESU L T S* ) 
, J ) , J = 1,KC ) 



110 



ill 



14 



ive 



199 



000079(1 

000080(' 

_pOpC^81(!; 

ooobe'z’ci 

000083(1 
U000o4t j 
00 00 850 

000086(i 

^(ippp87ci 
000088(1 
0000894 
00009 QC; 
000091(1 
000092C* 
000093C 



000094(i 

000095C 

000p96( 



,181 



K=T,KP 
J=1 ,53 
1 = 1,8 
0 



122 



I 






00 : 122 1 = 1,28 

NO ( I , J ) =0 

DO 125 1 = 1, KC 

w('i,n = i. 

W( I ,KPP (K, I )+KC)=l, 
we I ,KPC (K, I )+KC+KT)=r 
W('I,KCT1 )=KRPC(K,I ) 



ERIC 



0000 9 7( 
0000 98 (| 
. 000 0 99 !| 
0()0 luO!| 
OOOlOlrt 
OO OIO 2 I 
6i/oi 03| 

000104 I 
000105 ’ 
”66(u' i's 
000107 
pplJlOR 

” 00 016 9 
000 110 
000 111 
(JOOUl 
000113 ; 
OOp 114 
6661 1’5“ 
000116 
J30qjl7i 

60b 11 81 

000119; 



■383 



5to2 





KCM1=KC-1 

Nl=l 

LA=0 




00012C0 

00012)0 

0001220 




DO 130 I=lfKCMl 
N1=N1+1 

DO 130 J=N1,KC 




0001230 

0001240 

0001250 


L30 


LA=LA+1 

DO 130 L=1,KCT1 
WD<LA,L)=W( I,L)-W(J,L) 




0001266 

0001270 

0001280 




D0134I“1tLA 
DO 134 J=ltKCTT 
DO 134 L=1,KCT1 




0001290 

0001300 

00C131U 


L34 

L35 

* 


WW( J,L)=WW ( J ,U+WD( I ,J )*WD (I f U 
COIMT INUE 

CONDITIONING DIFFERECCE MATRIX 




0001320 

0001330 

0001340 




DO 140 I=1,KCT1 
WW(KC»I)=0 
WW< KC+KT ♦ I ) = 0 




0001350 

0001360 

000137U 


.40 


WW< KCTT » I ) = 0 
Nl=l 

DO 150 I=KC»KCTTtKT 




00013BQ 

0001390 

0001400 


.49 

sn 


DO T49 J=N1»I 
WW( I » J)=l. 

Nl^ I + l 




0001410 

0001420 

0001430 




N=KC+KT+1 
DO 175 1=1,53 
DO 175 J=l,.53 




0001440 

0001450 

0001460 


75 


Q( I , J ) =0 
DO 190 K=l,3 

IF< < K.EQ.3) .AND. ( ( I PC 'I^KC ) . LT. (KCTT-1) ) ) 


GO TO 260 


0001470 

o6oi4bo 

0001490 


85 


DO 185 1 = 1, KCTT 
DO 185 J=1,KCT1 
Q< I , J )»WW ( I , J ) 




0001500 

0001510 

0001520 




I F( K.EQ.3) GO TO 181 

M=N+KT-1 

DO 180 I = N,i''t 




0001530 
000 1540 
0001550 


80_ 


DO 180 J=1,KCT1 
Q( I , J)=0 
0( I,I) = 1. 




000 1560 
0001570 
0001580 


81 

92 


n=n-kt 

DO 192 1 = 1, KCTT 
V( I ) =Q( I ,KCT1 ) 




000 1 590 
0001600 
0001610 


89 


CALL LINEQ(KCTT,Q,V,1 ,DET,MORT ,53) 
JSW< K)=M0RT+1 
IF(MORT.NE.O) GO TO 186 




0001620 

0001630 

0001640 


88 


DO 188 1=1, KCTT 
RV( K, I )=V ( I ) 

GO TO 190 




- 0 OUT 650 

0061660 
O0O167U 


60“ 

;61 

! 


l?FfrTE(6,261) 

FORMAT! //,' INADEQUATE FOR CAHRY-OVEK') 
JSW< 3)=4 




0001680 

0001690 

0001700 


:86 

87 


DO 187 1 = 1, KCTT 

RV{K,I)=0 

CONTINUE 




000 1710 
0001720 
0001730 


102 


WRITE! 6 ,902 ) NPAGE 

FORMAT! ' 1' ,///, ' ESTIMATES OF VARIABLES' 
NPAGE=NPAGE+1 


,T127,I3) 


0001740 

0001750 

0001760 


igi" 

|D3 

s 


WRITE! 6,203 )! !HED!I,K),I=l,3),K=l,3,2) 
FORMAT! ///,2(28X,3A4) ,//) 

O 1 




0001770 

U0017B0 

0001790 






rERIC 



n 384 



583 



N2 = KC “ ““ 

DO 209 1=1,3 

WRITE(6,2Q5) MIDIIL 

205 F0R('iaT(52X,AS) ' “ 

DO 20 6 N=Ml,|\i2 

206 WRITEJ 6,204) RV ( 1 . i \l ) « RV ( 3 .N 1 

N1=N2+1 

209 N2=N2+KT 

2 0 4 .XO R M A T < 2 { 2 a X i FI 2 . 4 ) ) 

WRITE( 6 ,401 ) ( ( DEO ( L , JSW ( I ) ) , L=1 ,6 ) , 1=1 , 3,T) 

401 FORFiAK / , 2 ( 16X , 6A4 ) ) 

DO 200 1=1, KP 

DO 200 J=1,KC - — ""■■■ 

I F( KPP ( I , J ) , EO . 0 ) GO TO 200 
WV< J)=WV (J)+KRPC(I,J) 

WV ( KPP ( I , J ) +KC )'=WV fKPP ( I , J) +KC ) +KRPTrr731 
WV(KPC(I,J )+KC+RT)=WV(KPC(I , J ) +KG+K T ) +KRPC ( I , J ) 
201 TSA=TSA+KkPC ( I_, J ) 

TSSA=TSSA+ ( KRPC ( I /j )5;=KRPC ( I , J) ) ^ 

C=C+1 , 

A( I )=A( I ) + l. 

B(J)=6(J)+1. “ ■ 

G( KPP{ I ,J ) ) = G(KPP < I , J ) )+l. 

D(KPC(I,J ))=D(KPC(I,J )}+l. 

200 CONTINUE ^ ^ — 

DO 300 K=l,3 

IF ( JSW( K) .NE , 1 ) GO TO 3 00 
TSS=T6SA ■ ' ^ 

TS=T6A 

DO. 210 1=1 ,KCTT 

210 TSS=TSS-(kV (K, I )WvTl )T ^ ■ 

HU=0 

DO 220 1=1 ,KT 

220 MU=G( I ) «RV (K, I +KC) +DTiT^R V { K , KC + KT + I ) +hU^ "" 

MU=( TS-MU ) /C 
TSS=TSS-i''(U=^^TS 

DO 250 1=1 , KP • ■ ■ — 



0001800 
0001810 
-Ofi.0182p 
0001 B 30 
0001840 
0001850 
0001860 
0001870 
OOP I BBC 
0001890 
0CJ019U0 
00U191C 
0001920^ 
000193C 
Q00194C 
0001950 
U()01960 
0001971 
0001980 
000199C 
0_002i^0i 

00020 i'. 

OU0 202(. 
00020 3( 
0002041 
0Q0205C 
0002061 
000 2 070 
000208; 
00020 9; 
000210( 
0002110 
00Q 212I 
0002131 
000214(. 
0002151 

0002 16i 



230 

50 

300 



SA=0 

SB=0 

DO 230 J=1,KC ■ “' ■■■“ ^ 

$B=6B+KKHC (I , J ) 

S/A=KKPC( I , J )-KV ( K,KC+KPP ( I , J) )-RV ( K, KC+KT+KPC( I , J ) )-iv,u+SA 

C Ui'jT I NIJ E ^ ■“ - . 

SA=( SA/A II ) )*SB 
TSS=TSS“SA 

KS(K) = TSS 

CONTIiMUe 



0002171; 
0002180 
'0(){)2'r9' 
0o022Di: 
000^21^; 
000222'= 
0002231 
0002241 
00622 5' i 
000226 



FKP=FL(JAT (KP ) 

FI<C=FL0AT(KC) 

FI<T = PLOAT IKT) 

SSC=0 

Du 310 1=1 ,KC 
; A>10 SSC=S8C';'SC(1^'^';*2/FKP 
i a6R=0 

i DO 320 , 1 = 1 ,KP 

320 6SR = SSK+5R( I )*:««2/FKC 

KS(4)=TSSA+I ITSA5;«TSA)/C)-SSC-SSK 
UF( 1)=C-FKP-FKC+1. 

UF( 2)=C-FKP~FKC-FKT+2. 





0J)022_V| 
000228? 
0002291 
000230? 
6002 31^ 
0002321 
0 0023 3^ 
0002 3 4| 
0002 351 
0002361 
0002 3 7| 
00023^1 



'3Sk 



903 



OF VARIANCE' f T 1 2 7 » I 3 ) 



331 

332 

335 

33B 

333 



' » ‘ 



residual variability* 
7Zz:^-rzz'-~ _ H- _ , — 



33 6 
334 
337 



3 9U 
391 
'-!■(.)□ 
301 



DF( 3) = C-FKP“F'kC-2.>:'FI<T+3 
WRITE(6,9U3) MPAGE 

FOKFiAK '1' »///' Aj'^A LYSIS 

i\| P A F E= i’'! F A G E + 1 
DO 400 K=lt3 

I F { J S W ( l< > .NE.l ) GO TO 3 90 

W R I T E { 6 f 3 3 1 ) 

FORNAT( ///,19X, 'FACTORS' ,18Xt ' I D.F 

WKITE( 6,332 ) ^ 

FOKI'IAK ' 77”” 

DO 33 5 J=l»3 

RESHED<4+Jtl)=RESSUB( J,LTW(K) ) 

RESHED( 6+J t2) = RESSUii ( J ,LBW (K ) ) 

00 33B J=lf2 ^ 

WKITE(6,333) (HESHEPC I ,J ) »I = lt9) tOFC LUCK, J) ) ,KS( LK( In, J) 

F0Ri'iAT(4X,9a 4,4X, ' | ' ,F4.U, ' | * ,2X,FlU.2j 

WRITE(6,332) 

DFF = OF{Ln(K,l) )-DF"(LD(K,2)) 

RE=((RS(Lk(K,1) )-KS(LR(K,2)) )/(OFF))/(RS( LR(K,2 

WRI T E( 6 , 336 ) RS ( LR ( K , 1 ) ) ,RS ( LK ( K ,2) ) , OFF, RE 
FORMAK // ,21X, • ( ' ,F¥',2 
WKITE< 6,334) 



0002390 
00024UO 
U_U0 2410 
"0UU242(; 

0002430 
_00_0244o 
■’0002 450 
0002460 
0002470 
00024ViO 
0002490 
_0 0 0 2 5 00 
'000251 u 
0002520 
000 A P 30 



000 2 54u 
000 2 550 
000 2 5 Ot) 



;) )/u 

4TF872;^ T7^ 7F^rtrr6T7'F5 . 



F( LD( K,2 ) ) ) 

2T 



7X , ' F ' ,7X , 



F 0 R h A T < ' + ' , 

WRITE(6,337i DFF,DF(LU(K,2) ) ,KS(LR(K,2) ) ,0F( LU( 



k72)1 



9X ,F3 ,0 , ' , ' , F3 



;o TO 



FORHATC 

IF< JSW( 3 ) .NE.l i 

GO TO 400 

W K I T E ( 6 , 3 9 1 ) ( U EU t L , J S b 
format ( / / , 1 X , 6a4 f_/_n 
CONTINUE 
READ(5,26) IT 
IF( IT. EQ. 1 ) GO TO 
FORi'iArC 1X,17F4*1) 

F 0 R I' i A T ( 1 X , 9 F B . 3 ) 

FORMAT < IX , F12.4 ) 

CALL EXIT 
END 



■ 0 , 

501 



8X , F8. 2, ' / ' , F 3. 0) 



(K) ) ,L=1,6) 



101 



T30'02“57U 
000 2 5£}0 
0002590 
0002 60 0 
0002610 
JJ00 2 62U 
0002 6 3u 
000 2 6^ 0 
J)_002 650 
OOU2 T 6 U 
0002 6 7u 

000 2 6 HO 
’6002690 
0002 7 MU 
00 027 1 0 

000 2 77 U 
00u273i • 

'^0002 7 bU 
00D276(j 



M. 



■’i 

■n 




